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29  Sep  B7 

DISTRIBUTION  OF  QUALITY  (DQ)  REPORT 
FOR  71Q* 

a.  Summary 

(1).  The  Public  A-f-fairs  Proponent  Activity  believes  the 
Required  Recruit  Accession  Quality  Mix  currently  in  effect 
represents  a  satisfactory  level:  Category  I-IIIA  represents  98%» 
and  Category  I I IB  represents  the  remaining  2%.  These  levels  are 
required  to  maintain  the  integrity  of  the  Career  Management 
Field.  To  establish  or  accept  a  lessor  standard  would  jeopardize 
the  credibility  of  the  entire  United  States  Army. 


(2).  These  quality  accession  standards  are  needed  because 
of  the  following: 

How  many  Skill  Level  1  soldiers  from  any  CMF  can  you  imagine 
asking  sensitive  questions  for  a  print  interview  concerning 
issues  that  might  be  seen  on  the  Six  O’clock  news? 

When  Defense  Information  School  graduates  arrive  at  their 
first  assignments*  they  are  immediately  subject  to  the  scrutiny 
and  criticism  of  their  audience.  In  print  journalism*  this 
audience  may  encompass  twenty  thousand  or  more  members  each  week* 
in  broadcasting — both  radio  and  television — the  Skill  Level  1 
soldier  is  exposed  daily  to  an  audience  of  thousands  of  American 
soldiers  and  foreign  nationals.  Foreign  media  consider  any 
soldier  an  official  spokesman  for  the  entire  military*  and  for 
the  U.S.  government. 

Most  career  fields  can  train*  prepare*  and  further  polish 
Skill  Level  1  soldiers  beccuse  they  work  in  environments  with 
medium-to-heavy  concentrations  of  soldiers  in  the  same  MOS  and 
skill  level.  But  the  opposite  is  true  for  the  Public  Affairs 
soldier. 

Young*  often  inexperienced  Public  Affairs  practitioners  are 
highly  visible  both  within  and  outside  a  command.  These  soldiers 
perform  three  types  of  functions  for  any  Public  Affairs  shop: 
They  disseminate  Command  Information  (via  newsprint*  etc.)  and 
Public  Information*  and  perform  Community  Relations  work.  The 
latter  two — Public  Information  and  Community  Relations — bring  the 
Skill  Level  1  soldier  routinely  in  touch  with  civilian  media  and 
dignitaries  to  an.  extent  unequal led  by  any  other  MOS  in  the  Army. 


*POC  for  statistical  methodology  is  Dr,  Phillip  L.  Vandivier  <AV' 
699-3821) . 
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b.  Target  Skill  Level 


(1).  Skill  level  <SL)  1  (E-1  TO  E-4)  was  used.  SL  1  was  * 
selected  because: 

The  SL  1  soldier  -from  the  Public  A-f-fairs  -field  must  be  the  ■ 
kind  o-f  individual  who  can  -function  independently  in  a  stressful  ; 
environment?  publicly  using  speaking  or  writing  skills  on  behalf  i 
of  the  command  or  his  commander. 

Consider?  for  example?  the  light  division:  Out  of  the  74  i 
enlisted  positions  in  the  HHC  G-staff?  there  are  three  Public  ' 
Affairs  slots.  By  comparison?  there  are  three  times  as  many  ; 
stenographers  as  Public  Affairs  assets.  The  finance  support  unit  : 
iias  42  and  the  personnel  service  company  has  45  SL  1  solders —  ' 
compared  to  two  SL  1  soldiers  in  the  Public  Affairs  shop. 

Granted?  mission  differences  do  exist?  but  the  point  here  is  3 
that  the  Public  Affairs  soldier  at  SL  1  often  operates  I 
independently?  with  little  professional  guidance  immediately  i 
available.  The  Public  Affairs  soldier  in  search  of  a  story  may  i 
interview  a  field  grade  or  flag  rank  officer?  or  may  be  covering 
a  group  of  U.S.  or  foreign  soldiers  and  local  civilians.  For  this  3 
reason?  performance  of  SL  1  soldiers  is  critical  for  mission 
success. 

■j 

c.  Performance  Measure  i 

(1).  The  Skill  Qualification  Test  (SQT)  was  used  to  evaluate 
proficiency  in  the  MOS.  The  selection  of  the  SQT  is  based  on  the 
assumption  that  this  measurement  provides  an  acceptable  estimate 
of  performance  of  critical  MOS  tasks.  Furthermore?  the  SQT  was 
used  because  it  provides  a  reliable?  valid  means  of  estimating 
the  ability  to  perform  critical  tasks  at  SL  1. 

(2).  Content  Validity 


Content  validity  is  the  extent  to  which  a  test  measures  job  j 
performance  in  the  MOS.  The  SQT  was  systematically  validated  for 
content  by  the  Public  Affairs  Proponent  Activity  using  a  series 

of  rigorous  checks  and  reviews  outlined  in  TRADOC  Regulation  351- 

2?  Skill  Qualitif ication  Test  <SQT)  and  Common  Task  Test  (CTT) 
Development?  Policies?  and  Procedures,  These  procedures  included— - 

a  review  of  the  SQT  task  list?  peer/psychometr ic  review  of  each _ ■ 

task  test?  expert/murder  board  review?  editorial  review*  {f 
untrained  tryout?  soldier  tryout*  setting  task  training  C 

standards?  assigning  final  administt  ation  time  limit?  setting  C 

minimum  passing  score?  and  final  review  of  camera  ready — 3 
materials,  — ^ 

(2,),  Reliability 

An  estimate  of  the  internal  reliability  of  the  test  is 
important  to  determine  the  extent  to  which  the  instrument  is^j 


consistent  (within  itsel-f)  in  measuring 
Coefficient  Alpha  procedure  was  used  to 
reliability  of  the  SL  1  SQT.  Coefficient 
estimate  of  the  extent  to  which  all  test 
with  one  another.  A  coefficient  of  .791 
indicates  the  SL  1  SQT  has  moderate  internal 


performance.  The 
estimate  internal 
Alpha  provides  an 
items  intercorrelate 
was  obtainedf  which 
reliability. 


d.  Research  Design  and  Implementation 

(1).  Test  Administration  and  Data  Collection  Procedures 

SQTs  were  administered  lAW  procedures  outlined  in  TRADOC  Reg 
351-2.  Also,  the  Armed  Services  Vocational  Aptitude  Battery 
JLASVAB)  was  administered  upon  soldier  entry  into  the  Army  lAW 
routine  procedures. 

Data  was  extracted  from  official  test  results  obtciined  from 
the  Military  Personnel  Center  with  the  help  of  the  SSC-NCR 
Liaison.  All  245  available  cases  (the  entire  population  of  SL  1 
71Qs)  were  used  for  data  analyses. 

(2).  Analyses  were  conducted  with  the  use  of  the  Statistical 
Package  For  the  Social  Sciences — Personal  Computer  Plus  package. 
Results  are  as  follows* 

<a) .  A  stepwise  multiple  regression  procedure  was  conducted  to 
determine  what  combination  of  ASVAB  Aptitude  Areas  C Armed  Forces 
Qualification  Test  (AFQT) ,  General  Technical  (GT) ,  Clerical  (CL), 
Combat  (CO),  Electronics  Repair  (EL),  Field  Artillery  (FA), 
General  Maintenance  (GM) ,  Mechanical  Maintenance  (MM), 
Qperators/Food  (OF),  Surveillance/Communications  (SC),  and 
Skilled  Technician  (ST)  scores!  did  the  best  job  of  predicting  SL 
1  SQT  scores.  Multiple  regression  is  the  preferred  procedure  used 
in  the  behavioral  sciences  when  the  object  is  to  determine  which 
of  several  combinations  of  predictors  does  the  best  job  of 
predicting  a  single  criterion!  and  to  determine  how  much  weight 
each  predictor  has  in  the  prediction  of  the  criterion.  Results 
indicated  EL  significantly  (r=+.39!  F=38.96i  p<.001)  predicted 
SQT.  A  total  of  15  per  cent  of  the  variance  in  SQT  scores  was 
explained  by  EL.  No  other  variable  made  a  significant  or  unique 
contribution  to  the  prediction  of  SQTs  above  and  beyond  that 
provided  by  EL.  For  this  reason,  the  multiple  regression 
procedure  was  reduced  to  a  simple  Pearson  r  between  EL  and  SL  1 
SQTs. 

Although  statistically  significant,  the  strength  of  the 
predictive  relationship  between  EL,  on  the  one  hand,  and  SL  1 
SQT  scores,  on  the  other,  can  best  be  described  as  mild*  Although 
15  per  cent  of  the  variance  in  SQT  scores  was  explained,  a  total 
of  85  per  cent  of  SQT  variance  remains  unexplained  by  ASVAB 
results. 

Please  note*  Mild  but  statistically  significant  Pearson  r 
correlations  were  found  for  al 1  other  Aptitude  Area  predictors 
including  GT  (r=+.34;  p<.001),  ST  (r=+.35!  p<.001),  AFQT  (r=+.32! 


p<.001),  and  FA  (r=+.33|  p<.001).  <The  large  sample  size 
undoubtedly  contributed  to  the  finding  of  numerous  positive 
correlations  with  SQTs.  Nevertheless5  none  of  these  variables 
significantly  added  to  the  prediction  of  SQT  scores  above  and 
beyond  what  was  provided  by  EL  results.  (Technically?  none  of 
these  variables  made  significant  contributions  to  the  prediction 
of  SQTs  after  EL  results  were  already  entered  into  the  regression 
equation. ) 


(b) .  A  breakdown  of  SL  1  SQT  averages  by  mental  category 
(determined  by  AFQT  results)  follows.  A  visual  inspection 
indicates  that  SQTs  increase  with  mental  category.  Nevertheless? 
a  one-way  analysis  of  variance  was  performed  to  determine  whether 
mean  differences  are  significant. 


SL  1  SQT  Averages 

By  Mental  Category 

Mental  Category 

SQT  Averages 

T 

85.  15 

II 

81.34 

IIIA 

79.62 

IIIB 

74.00 

Overall  analysis  of  variance  results  indicated  significant 
differences  (F=5.S5;  p<.00l)  e:<ist  between  some  of  the  means.  A 
subsequent  post  hoc  analysis — the  Tukey  procedure — was  applied  to 
all  possible  mean  combinations  to  determine  exactly  which 
comparisons  were  significant.  Tukey  results  disclosed  that 
mental  category  I  soldiers  perform  significantly  (p<.05)  better 
than  soldiers  in  II?  IIIA?  and  IIIB.  No  other  possible  mean 
comparisons  (II  vs.  IIIA?  IIIA  vs.  IIIB?  etc.)  resulted  in 
significant  differences.  As  indicated  above?  a  Pearson  r 
analysis  indicated  a  mild  but  significant  positive  correlation 


between  AFQT  results  and  SQTs  (r=.32?  p<.001).  These  analyses  i 


provide  evidence  that  SQT  results  ^  tend  to  increase  with  mental  1 


category — BUT  ESPECIALLY  AT  THE  UPPER  END  OF  THE  MENTAL  SCALE. 


(c) .  A  minimum  passing  SQT  score  of  60  was  used  in  accordance 
with  guidance  from  TRADOC.  A  frequency  distribution  was  made  of  ; 
the  percentages  of  SL  1  71Qs  who  passed  and  failed  (using  the  ; 
minimum  passing  SQT  score)  across  different  mental  categories. 
Results  were  as  follows:  I 


PERCENTAGE  OF  PASS/FAILS  BY  MENTAL  CATEGORY 


MENTAL  CATEGORY 


I-IIIA  IIIB  IV  1 

S  ? 

Q  FAIL 

T  (59  and  .BV.  OV.  0% 

below)  n=2  n=0  n=0 

S  _ _ 

C  PASS 

0  (60  and  99.2%  100%  0% 

R  above)  n=236  n=6  n=0 

£ _ I 

S  i 

1 

The  very  low  -Failure  rate  -For  71Qs  (less  than  1%)  precluded  much  | 
variation  o-f  -Frequencies  o-F  passes  and  -Failures  across  mental  | 
categories.  For  this  reason?  these  results  -Fail  to  support  the  1 
contention  that  higher  mental  category  soldiers  per-Form  better  on  | 
the  SL  1  71Q  SQT  than  their  lower  mental  -Functioning  | 

counterparts.  | 

(d).  A  simple  -frequency  distribution  was  run  to  determine  the  i 

breakdown  of  soldiers  by  AFQT  mental  categories  in  our  sample.  | 

Results  indicated  the  -followings  | 


SAMPLE  PERCENTAGES  BY  AFQT 
MENTAL  CATEGORY 


I 

II 

IIIA 

IIIB 

IV 

18.  9% 

66. 8% 

11.9% 

2.4% 

0% 

n=46 

n=163 

n=29 

n=6 

n=0 

Please  note  that  97.6%  of  the  soldiers  in  this  study  were  in 
mental  categories  I  to  IIIA»  which  compri-se  the  upper  50  per  cent 
of  the  soldier  population*  and  that  NEARLY  ONE  IN  FIVE  ARE  IN 
CATEGORY  I — THE  UPPER  7  PERCENT  OF  THE  ARMY  POPULATION.  These 
percentages  provide  an  approKimate  estimate  of  the  present  mental 
category  breakdown  for  71Qs  at  SL  1. 

(e).  To  determine  future  71Q  acces'ion  requirements*  the 
following  steps  were  taken  CNOTE:  These  steps  are  outlined  in 
Appendix  G  of  the  Distribution  of  Quality  Program  Handbook!: 

(1) .  A  frequency  distribution  wjs  made  of  ST  scores.  ST 
results  were  used  because  a  minimum  ST  score  is  required  for 
entry  into  the  MOS.  <GT  was  not  used  because  information 
necessary  to  transform  GT  frequencies  into  an  accession  mix  was 
not  available  in  the  Distribution  of  Quality  Handbook.) 

(2) .  The  frequency  distribution  of  ST  scores  was 
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converted  to  an  approximate  mental  category  distribution  using 
tables  and  procedures  outlined  in  the  Distribution  o-f  Quality 
Program  Handbook.  CNOTE:  The  -frequencies  o-f  soldiers  which  -fell 
within  each  5-point  ST  score  category  were  multiplied  by  separate 
■factors  -for  each  mental  category  which  converted  ST  results  into 
an  estimated  frequency  distribution  of  soldiers  by  mental 
category.  Please  refer  to  Appendix  S  of  the  Distribution  of 
Quality  Program  Handbook  for  further  clarification  and  examples 
of  this  procedure. 3 

(3)  .  Percentages  for  each  mental  category  were 
determined  by  dividing  the  frequencies  of  sums  for  each  category 
by  the  overall  total  for  all  categories.  (Percentages  were  88.3 
for  category  I-IIIA;  10.5  for  I I IB;  and  1.2  for  IV.) 

(4) .  Mental  category  percentages  were  not  divided  by 
historical  continuation/survival  rate  factors  because  the  SL  1 
soldiers  are  presently  available  and  performing  the  critical  71Q 
tasks.  Continuation/survival  factors  are  used  to  control  for  the 
fact  that  only  a  portion  of  all  soldiers  entering  the  Army  will 
continue  to  serve  beyond  the  first  or  second  enlistment;  however, 
with  the  71Q  the  critical  level  is.  SL  l:  Because  100%  of  these 
soldiers  are  already  in  the  Army,  there  is  no  reason  to  control 
for  attrition  which  results  at  reenlistment  time. 


e.  Conclusions  and  recommendations 

(1).  In  conclusion,  this  study  found  that! 

<a) .  Electronics  Repair  did  the  best  job  of  predicting 
soldier  performance  on  the  71Q  SL  1  SQT.  No  other  predictor 
variables  added  anything  unique  to  the  prediction  of  SQTs  after 
Electronics  Repair  had  been  taken  into  account. 

(b) .  Overall  results  generally  suggest  SL  1  71Q5  in 
higher  mental  categories  tend  to  perform  better  on  the  SL  1  SQT 
than  those  in  lower  mental  categories.  This  finding  is  especially 
apparent  at  the  upper  end  of  the  mental  category  scale  (mental 
category  I  soldiers).  A  distribution  of  passes  and  failures 
broken  down  by  mental  category  failed  to  show  a  relationship 
between  mental  category  and  SQTs.  However,  these  results  are 
misleading  because  the  very  small  failure  rate  precluded  the 
variability  in  data  needed  for  the  establishment  of  such  a 
relationship. 

(c)  .  Of  particular  significance  is  the  fact  that  71Q 
PRESENTLY  IS  VERY  TOP  HEAVY  ON  THE  MENTAL  CATEGORY  SCALE: 
Approximately  98  per  cent  of  SL  1  71Qs  presently  are  in  mental 
categories  I-IIIA;  and  2  per  cent  are  from  I I IB.  None  are  from 
IV. 


(d).  According  to  statistical  analysis  results,  88  per 
cent  of  future  71Qs  should  come  -from  mental  category  I-IIIAl  11 
per  cent  should  come  from  I I IB?  and  1  per  cent  should  come  from 
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ly.  However,  it  is  important  to  note  that  these  standards  are 
signi-f icantly  below  the  eKistent  quality  mix  of  98  per  cent  from 
I-IIIA.  (A  full  19  per  cent  are  from  mental  category  I!). 

(e) .  RECOMMEND  the  use  of  the  following  multiple 
regression  equation  which  uses  Skilled  Technician  results  to 
predict  success  of  future  71Q  recruits  on  the  SL  I  SQTs 

(.2903)  K  (ST)  +  (47.12)  =  Predicted  SQT  Score 

example: 

(.2903)  K  (85)  +  (47.12)  =  71. SO 

Any  score  which  falls  within  8  points  of  the  SQT  cutoff  (60) 
indicates  an  individual  who  is  at  high  risk  for  failing  the  SL  1 
SQT.  For  example,  a  recruit  who  scores  85  on  ST  obtains  a 
predicted  SL  1  SQT  score  of  71.80 — which  is  not  within  8  points 
of  the  cutoff  (60) ?  therefore,  this  soldier  is  not  high  risk  for 
failure  on  the  71Q  SQT.  Please  note:  High-risk  individuals  who 
are  motivated  and  interested  in  a  71Q  career  might  try  hard  and 
be  fully  successful  on  the  SL  1  SQT|  nevertheless,  in  the  long 
run  more  high-risk  soldiers  will  have  trouble  with  SQTs  than 
nonhigh-risk  individuals. 

(9) .  RECOMMEND  further  studies  be  conducted  to  determine 
whether  ST  or  ST  results  as  presently  configured  should  continue 
to  be  used  as  prerequisites  for  accession  into  the  71Q  MOS.  This 
recommendation  is  based  on  the  finding  that  EL  did  a  better  job 
of  predicting  SL  1  SQT  performance  than  did  either  ST  or  GT.  Part 
of  the  reason  for  this  finding  is  that  Aptitude  Area  Composite 
scores  often  include  overlapping  ASVAB  subtest  scores.  For 
example,  EL  includes  two  of  the  four  subtest  scores  which  are 
summed  to  derive  ST  results.  This  fact  partially  explains  the 
seemingly  illogical  finding  that  EL  scores  do  a  better  job  of 
predicting  71Q  SL  1  SOTs  than  ST  scores.  Nevertheless,  one  would 
expect  that  ST  should  be  the  best  predictor  if  it  is  to  be  used 
as  a  standard  for  accession  into  71Q.  For  this  reason,  studies 
should  be  conducted  to  determine  whether  and  how  other  ASVAB 
sub test  score  combinations  should  be  used  to  do  a  better  job  of 
predicting  success  on  the  71Q  SQT. 

<2) ,  The  need  for  requiring  Category  I-IIIA  soldiers  for 
accession  to  CI1F  46  has  never  been  more  critical.  In  an 
evnironment  where  everything  is  automated  and  we  have  ''fast  food" 
news  reporting,  today’s  new  public  affairs  soldier  must  be  able 
to  think  logically  and  act  precisely  with  common  sense  and 
sensitivity  with  minimal  supervision.  How  does  one  put 
mathematical  value  on  the  ability  to  use  mature  judgment, 
professional  ethics,  or  showing  the  ability  to  react  responsibly 
in  a  crisis  situation.  The  societal  pool  from  which  we  have  ta 
deraw  does  not  reflect  any  common  denominator  that  can  be  used  to 
predict  any  large  amount  of  success.  The  most  important  factor 
missing  from  mathematical  formulas  is  the  "human"  factor.  Vie  must 
continue  with  a  nealthy  posture  and  a  high  quality  mix  so  that 
the  public  affairs  field  may  maintain  an  acceptable  standard  of 
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success. 

(3).  Once  again,  statistical  analysis  results  showed  that  88% 
of  71Qs  should  come  from  I-IIIA,  11%  should  come  from  I I IB,  and 
1%  should  come  from  IV.  The  Public  Affairs  Proponent  Activity 
feels  these  accession  figures  are  not  adequate  due  to 
aforementioned  reasonss  The  SL  1  mix  cannot  fall  below  98%  from 
mental  categories  I-IIIA  and  2%  from  I I IB  without  creating  a 
critical  loss  of  skilled  manpower  for  the  future. 
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DI8TRIBUTiaN  OF  QUALITY  (DQ)  REPORT 
FOR  71R# 


«.  Summary 

(1).  Th«  Public  A-f-fairs  Proponant  Activity  baliavaa  tha 
Raquirad  Racruit  Accaaaian  Quality  Mix  currantly  in  a-f'fact 
rapraaanta  a  mat ia-factory  lavali  Catagory  I-IIIA  rapraaanta  9B7.f 
and  Catagory  1 1  IB  rapraaanta  tha  ramaining  27..  Thaaa  lavala  ara 
raquirad  to  maintain  tha  intagrity  o-f  tha  Caraar  Managamant 
Field.  (The  currant  operating  strength  ia  laaa  than  50  par  cant 
cf  what  is  authorized  at  Skill  Level  1.)  To  establish  or  accept 

lessor  standard  would  Jeopardize  tha  credibility  of  tha  entire 
United  States  Army. 


(2).  These  quality  accession  standards  are  needed  because 
of  the  followings 

How  many  Skill  Level  1  soldiers  from  any  CMF  can  you  imagine 
on  the  Six  O’clock  newsi  or  asking  sensitive  questions  for  an  on- 
camera  interview? 

When  Defense  Information  School  graduates  arrive  at  their 
first  aaaignmentsi  they  are  immediately  subject  to  the  scrutiny 
and  criticism  of  their  audience.  In  broadcast  journal  ism— both 
radio  and  television — the  Skill  Level  1  soldier  is  exposed  daily 
to  an  audience  of  thousands  of  American  soldiers  and  foreign 
nationals.  Foreign  madia  consider  anv  soldier  an  official 
spokesman  for  the  entire  military*  and  for  the  U.S.  Government. 

Most  career  fields  can  train*  prepare*  and  further  polish 
Skill  Level  1  soldiers  because  they  work  in  environments  with 
medium-to-heavy  concentrations  of  soldiers  in  the  same  MOB  and 
skill  level.  But  tha  opposite  is  true  for  the  Public  Affairs 
soldier.  Thera  are  only  58  Skill  Level  1  broadcast  Journalists 
Army-wide. 

Young  Public  Affairs  practitioners  are  highly  visible  both 
within  and  outside  a  command*  and  these  soldiers  perform  three 
types  of  functions  for  any  Public  Affairs  shopi  They  disseminata 
Command  Information  (via  newscasts*  etc.)  and  Public  Information* 
and  perform  Community  Relations  work.  This  work  often  entails 
remote  locations*  operating  independently*  or  even  assigned  as 
station  manager  and  having  to  conduct  business  with  no  immediate 
supervision  available.  How  does  one  prepare  young  Skill  Level  i 
soldiers  to  show  poise*  composure*  agility*  maturity*  ethics*  and 
honor?  The  Skill  Level  1  broadcast  journalist  routinely 
communicates  with  civilian  media  and  dignitaries  to  an  extent 
unequalled  by  any  other  MOS  in  the  Army. 


*P0C  for  statistical/research  portions  of  this  report  is  Dr. 
Phillip  Uandivier,  AV  699-3821. 
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b.  Target  Skill  Level 


(1).  Skill  level  (SL)  1  (E-1  TO  E-4)  was  used.  SL  1  was  ; 
selected  because! 

The  SL  1  soldier  -from  the  Public  A-f-fairs  -field  must  be  the  ■ 
kind  o-f  individual  who  can  -function  independently  in  a  stress-ful 
environment,  publicly  using  speaking  skills  on  behal-f  of  the 
command  or  his  commander  to  an  unlimited  audience. 

Consider,  for  example,  the  light  divisions  Out  of  the  74 
enlisted  positions  in  the  HHC  G-staff,  there  are  three  Public 
Affairs  slots.  By  comparison,  there  are  three  times  as  many 
stenographers  as  Public  Affairs  assets.  The  finance  support  unit 
has  42  and  the  personnel  service  company  has  45  SL  1  solders — 
compared  to  one  SL  1  broadcast  journalist  in  the  Public  Affairs 
shop. 

Granted,  mission  c'  snces  do  exist;  but  the  point  here  is  ; 

that  the  Public  Affairs  soldier  at  SL  1  often  operates 
independently,  with  little  professional  guidance  available.  The 
Public  Affairs  soldier  in  Search  of  a  story  may  interview  a  field 
grade  or  flag  rank  officer;  or  he  may  be  covering  a  group  of  U.S. 
or  foreign  soldiers  and  local  civilians.  For  this  reason, 
performance  of  the  SL  1  soldier  is  critical  for  mission  success. 

The  only  occasion  when  there  may  be  more  than  one  skill  level  in  1 
the  same  facility  is  through  the  Army  Broadcast  Service,  at  an 
Armed  Forces  Radio  and  Television  affiliate.  I 


c.  Performance  measure 

<1).  The  Skill  Qualification  Test  <SQT)  was  used  to  evaluate 
proficiency  in  the  MOS.  The  selection  of  the  SQT  is  based  on  the 
assumption  that  this  measurement  provides  an  acceptable  estimate 
of  performance  of  critical  MOS  tasks.  Furthermore,  the  SQT  was 
used  because  it  provides  a  reliable,  valid  means  of  estimating 
the  ability  to  perform  critical  tasks  at  SL  1. 


(2).  Content  Validity 


Content  validity  is  the  extent  to  which  a  test  measures  job 
performance  in  the  MOS.  The  SQT  was  systematically  validated  for 
content  by  the  Public  Affairs  Department  using  a  series  of 
rigorous  checks  and  reviews  outlined  in  TRADOC  Regulation  351-2, 
Skill  Quantification  Test  (SQT)  and  Common  Task  Test  (CTT) 
Development,  Policies,  and  Procedures.  These  procedures  included 
a  review  of  the  SQT  task  list,  peer /psychometric  review  of  each 
task  test,  expert/murder  board  review,  editorial  review, 
untrained  tryout,  soldier  tryout,  setting  task  training 

standards,  assigning  final  administration  time  limit,  setting 
minimum  passing  score,  an.  final  review  of  camera  ready 
‘■trials. 
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(2. ) .  Rel iabi 1 ity 


An  estimate  the  internal  reliability  o-f  the  test  is 
important  to  determine  the  extent  to  which  the  instrument  is 
consistent  (within  itself)  in  measuring  performance.  The 
Coefficient  Alpha  procedure  was  used  to  estimate  internal 
reliability  of  the  SL  1  SQT.  Coefficient  Alpha  provides  an 
estimate  of  the  extent  to  which  all  test  items  intercorrelate 
with  one  another.  A  coefficient  of  .524  was  obtained?  which 
indicates  the  SL  1  SQT  has  a  moderate  (acceptable)  amount  of 
internal  reliability. 


d.  Research  Design  and  Implementation 

(1).  Test  Admin istrat ion  and  Data  Collection  Procedures 

SQTs  were  administered  lAW  procedures  outlined  in  TRADOC  Reg 
351-2.  Also,  the  Armed  Services  Vocational  Aptitude  Battery 
(ASVAB)  was  administered  upon  soldier  entry  into  the  Army  lAW 
routine  procedures. 

Data  was  extracted  from  official  test  results  obtained  from 
MILPERCEN  with  the  help  of  the  SSC-NCR  Liaison.  All  67  available 
cases  (the  entire  population  of  SL  1  71Rs)  were  used  for  data 
analyses. 

(2).  Data  analyses  were  conducted  with  the  use  of  the 
Statistical  Package  For  the  Social  Sciences — Personal  Computer 
Plus  package.  Results  are  as  follows: 

(a).  A  stepwise  multiple  regression  procedure  was  conducted  to 
determine  what  combination  of  ASVAB  Aptitude  Areas  CArmed  Forces 
Qualification  Test  (AFQT) »  Seneral  Technical  (ST)  »  Clerical  (CD? 
Combat  (CO),  Electronics  Repair  (EL),  Field  Artillery  (FA), 
General  Maintenance  (GM) ,  Mechanical  Maintenance  (MM), 
□perators/Food  (OF),  Surveillance/Communications  (SC),  and 
Skilled  Technician  (ST)  scores]  did  the  best  job  of  predicting  SL 
1  SQT  scores.  Multiple  regression  is  the  preferred  procedure  used 
in  the  behavioral  sciences  when  the  object  is  to  determine  which 
of  several  combinations  of  predictors  does  the  best  job  of 
predicting  a  single  criterion?  and  to  determine  how  much  weight 
each  predictor  has  in  the  prediction  of  the  criterion. 

Multiple  regression  results  must  be  interpreted  with  extreme 
caution  due  to  the  relatively  low  number  of  cases  available  for 
use  in  this  study.  Results  indicated  GM  and  FA  in  combination 
significantly  (R=  .552?  F=7.2i;  p<.01)  predicted  SL  1  71R  SQTs: 
A  total  of  30.4  per  cent  of  the  variance  in  SL  1  SQT  scores  was 
explained  by  GM  and  FA,  No  other  variable  or  variables  made  a 
significant  or  unique  contribution  to  the  prediction  of  SQTs 
above  and  beyond  that  provided  by  GM  and  FA.  GM  accounted  for 
approximately  11.8%  of  the  variance  in  SL  1  SQTs  (R=.3437? 
F=4.55;  p<.05),  followed  by  FA  (F=8.83;  p<.01),  which  accounted 
for  the  remaining  18.6  per  cent  of  the  variance  in  SQT  scores.  Of 
particular  significance  is  the  fact  that  GM  and  FA  are  positively 
(when  predictor  goes  up,  so  does  criterion)  and  negatively 


(predictor  and  criterion  tend  to  move  in  opposite  directions) 
related  to  SL  1  SQIs,  respectively.  The  strength  of  the 
predictive  relat-onship  between  GM  and  FAj  on  the  one  hand?  and 
SL  1  SQT  scores?  on  the  other?  can  best  be  described  as  moderate* 
Although  30.4  per  cent  of  che  variance  in  SQT  scores  was 
explained?  a  -cotal  of  69.6  per  cent  of  SQT  variance  remains 
unexplained  by  ASVAB  results. 

Please  rote*  No  statistically  significant  Pearson  r 
correlations  with  SL  1  71R  SQTs  were  found  for  any  of  the  other 
Aptitude  Area  ASVAE  predictors?  including  ST  Cr=  +.1215?  F-.51? 
p>.05)  and  GT  (■'=  -.032;  '^=.0348?  p>.05)?  both  of  which  are  used 
as  standards  rcr  accession  into  this  MQS. 

^  (b).  A  breakdown  of  SL  1  SQT  averages  by  mental  category 
(determined  by  AFQT  results)  follows.  Very  small  sample  sizes  of 
1?  S?  and  7  for  three  of  the  groups  precludes  the  establishment 
of  firm  conclusions  regarding  variation  of  SQTs  by  mental 
category.  Nevertheless?  a  one-way  analysis  of  variance  was 
performed  to  determine  whether  mean  differences  are  significant. 


SL  1  SQT  Averages  By  Mental  Category 


Mental  Category 

SQT  Averages 

N 

I 

76.43 

7 

II 

73.89 

27 

IIIA 

77.80 

5 

IIIB 

88.  00 

1 

TOTALS 

75.  18 

40 

Overall  analysis  of  variance  results  indicated  no  significant 
differences  (F=1.89?  p>.05)  exist  among  any  possible  mean 
combinations.  However?  once  again  the  small  number  of  cases  in  at 
least  three  of  the  groups  precluded  the  establishment  of  firm 
conclusions.  Nevertheless?  a  Pearson  r  analysis  indicated  no 
relationship  whatsoever  between  AFQT  and  SL  1  SQTs  (r=-. 18? 
F=1  20;  p>.0S). 

(c) .  A  minimum  passing  SQT  score  of  60  was  determined  by 
subject  matter  experts  at  the  school.  A  frequency  distribution 
was  made  of  the  percentages  of  SL  1  71Rs  who  passed  and  failed 
(using  the  minimum  passing  SQT  score)  across  different  mental 
categories.  Results  were  as  follows* 
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PERCENTAGE  OF  PASS/FAILS  BY  MENTAL  CATEGORY 

MENTAL  CATEGORY 


I-IIIA 

IIIB 

IV 

s 

Q  FAIL 

T  (59  and 

0*/. 

07. 

0*/. 

below) 

3 

II 

o 

n=0 

n=' 

PASS 

<60  and  100*/.  100*/.  1007. 

above)  n=39  n=l  n=0 


The  zero  level  -failure  rate  -for  71Rs  precluded  determination  o-f 
di -f -ferences  in  passes  and  -failures  as  a  -function  of  mental 
category. 

(d).  A  simple  frequency  distribution  was  run  to  determine  the 
breakdown  of  soldiers  by  AFQT  mental  categories  in  our  sample. 
Results  indicated  the  following: 


SAMPLE  PERCENTAGES  BY  AFQT 
MENTAL  CATEGORY 


I 

II 

IIIA 

IIIB 

IV 

17.57. 

67.57. 

12.57. 

2. 57. 

07. 

n=7 

n=27 

n=5 

n=l 

n=< 

Please  note  that  97.57  of  the  soldiers  in  this  study  were  in 
mental  categories  I  to  IIIA»  which  comprise  the  upper  50  per  cent 
of  the  soldier  population;  and  that  NEARLY  ONE  IN  FIVE  ARE  IN 
CATEGORY  I --THE  UPPER  7  PERCENT  OF  THE  ARMY  POPULATION.  Only  2.57. 
of  the  71R  SL  1  soldiers  come  from  category  IIIB»  which  is  below 
the  50th  percentile.  Neat  a  single  soldier  came  from  category  IV. 
These  percentages  provide  an  approximate  estimate  of  the  present 
mental  category  breakdown  for  71Rs  at  SL  1. 


(e> .  In  order  to  determine  future  71R  accession  requirements* 
the  following  steps  were  taken  CNOTE*  These  steps  are  outlined  in 
Appendix  G  of  the  Distribution  of  Quality  Program  Handbooks 


(1),  A  frequency  distribution  was  made  of  ST  scores.  ST 
results  were  used  because  a  minimum  ST  score  is  required  for 
entry  into  the  MOS. 


<2) .  The  frequency  distribution  of  ST  scores  was 
converted  to  an  approximate  mental  category  distribution  using 
tables  and  procedures  outlined  in  the  Distribution  of  Quality  J 
Program  Handbook.  CNDTE:  The  frequencies  of  soldiers  which  fell  | 


within  each  5-point  ST  score  category  were  multiplied  by  separate 
•factors  -for  each  mental  category  which  converted  ST  results  into 
an  estimated  -frequency  distribution  o-f  soldiers  by  mental 
category.  Please  re-fer  to  Appendix  S  o-f  the  Distribution  o-f 
Quality  Program  Handbook  for  further  clarification  and  examples 
of  this  procedure. 3 

(3)  .  Percentages  for  each  mental  category  were 
determined  by  dividing  the  frequencies  of  sums  for  each  category 
by  the  overall  total  for  all  categories.  (Percentages  were  86.3 
for  category  I-IIIA;  13.7  for  1 1 IB;  and  0  for  IV.) 

(4) .  Mental  category  percentages  were  not  divided  by  1 

historical  continuation/survival  rate  factors  because  the  SL  1  | 

.soldiers  are  presently  available  and  performing  the  critical  71R  | 

tasks.  Continuation/survival  factors  are  used  to  control  for  the  | 
fact  that  only  a  portion  of  all  soldiers  entering  the  Army  will  | 
continue  to  serve  beyond  the  first  or  second  enlistment;  however,  j 
with  the  71R  the  critical  level  is.  SL  U  Because  100/i  of  these  1 
soldiers  are  already  in  the  Army,  there  is  no  reason  to  control 
for  attrition  which  results  at  reenlistment  time. 

e.  Conclusions  and  recommendations 

(1).  In  conclusion,  this  study  found  that:  ; 

) 

(a).  Because  of  the  small  number  of  cases  used  in  this 
study,  results  should  be  interpreted  with  extreme  caution.  With 
this  fact  in  mind.  General  Maintenance  and  Field  Artillery  did 
the  best  job,  in  combination,  of  predicting  soldier  performance  ; 
on  the  71R  SL  1  SQT.  No  other  predictor  variables  added  anything 
unique  to  the  prediction  of  SQTs  after  these  two  predictors  had 
been  taken  into  account.  CPlease  note:  Because  of  the  small 
number  of  cases  for  this  MOS,  no  attempt  was  made  to  construct  a 
regression  equation  which  would  predict  future  success  on  SQTs 
based  on  past  performance. 3 

<b).  Very  little  additional  support  was  found  for  the 

contention  that  higher  mental  category  soldiers  perform  better  on 
the  SL  1  SQT  than  their  lower  mental  functioning  counterparts. 
Part  of  the  explanation  for  this  lack  of  support  might  be  the 
small  number  of  cases  in  different  mental  category  groups  as  well 
as  in  the  overall  study.  Nevertheless,  even  Pearson  r 

correlations  between  ASVAB  predictor  variables  (such  as  ST  and 

GT)  and  SQTs  were  not  significant. 

(c) .  Of  particular  significance  is  the  fact  that  71R 

PRESENTLY  IS  VERY  TOP  HEAVY  ON  THE  MENTAL  CATEGORY  SCALE: 
Approximately  98  per  cent  of  SL  1  71Rs  presently  are  in  mental 
categories  I-IIIA;  and  the  remainder  comes  from  I I IB.  None  come 
from  IV. 

<d) .  According  to  statistical  analysis  results,  86  per 

cent  of  future  71Qs  should  come  from  mental  category  I-IIIAi  14 
per  cent  should  come  from  I I IB;  and  0  per  cent  should  come  from 


6 


. . .III. . . . . . . 


IV.  However,  it  is  important  to  note  that  these  standards  are 
signi-f icantly  below  the  existing  quality  mix  of  VS  per  cent  from 
I-IIIA.  (Nearly  18  per  cent  are  from  mental  category  I!). 

(e) .  RECOMMEND  further  studies  be  conducted  to  determine 
whether  GT  or  ST  results  as  presently  configured  should  continue 
to  be  used  as  prerequisites  for  accession  into  the  71R  MOS.  This 
recommendation  is  based  on  the  finding  that  GM  and  FA  did  a 
better  job  of  predicting  SL  1  SQT  performance  than  did  either  ST 
or  GT.  Part  of  the  reason  for  this  finding  is  that  Aptitude  Area 
Composite  scores  often  include  overlapping  ASVAB  subtest  scores. 
For  example,  GM  includes  two  of  the  four  subtest  scores  which 
are  summed  to  derive  ST  results.  This  fact  partially  explains  the 
seemingly  illogical  finding  that  GM  scores  do  a  better  job  of 
predicting  71R  SL  1  SQTs  than  ST  scores.  Nevertheless,  one  would 
expect  that  ST  should  be  the  best  predictor  if  it  is  to  be  used 
as  a  standard  for  accession  into  71R.  For  this  reason,  studies 
should  be  conducted  to  determine  whether  and  how  other  ASVAB 
subtest  score  combinations  should  be  used  to  do  a  better  job  of 
predicting  success  on  the  71R  SQT. 

(2).  The  need  for  requiring  Category  I-IIIA  soldiers  for 
accession  to  CMF  46  has  never  been  more  critical.  The  nature  of 
Public  Affairs  business  precludes  establishing  a  clear-cut 
mathematical  formula  which  would  justify  such  accession 
requirements.  In  an  environment  where  everything  is  automated  and 
we  have  "fast  food"  news  reporting,  today’s  new  public  affairs 
soldier  must  be  able  to  think  logically  and  act  precisely  with 
common  sense  and  sensitivity  with  minimal  supervision.  How  does 
one  put  mathematical  value  on  the  ability  to  use  mature  judgment, 
professional  ethics,  or  showing  the  ability  to  react  responsibly 
in  a  crisis  situation?  The  societal  pool  from  which  we  have  to 
draw  does  not  reflect  any  common  denominator  that  -can  be  used  to 
predict  any  large  amount  of  success.  The  most  important  factor 
missing  from  mathematical  formulas  is  the  "human"  factor.  We  must 
continue  with  a  healthy  posture  and  a  high  quality  mix  so  that 
the  public  affairs  field  may  maintain  an  acceptable  standard  of 
success.  The  broadcast  journalist  is  commonly  known  as  the  voice 
of  the  command:  He  must  be  well  informed,  be  able  to  think  on  his 
feet,  be  able  to  talk  articulately  with  a  fair  level  of 
intelligence,  and  must  have  good  eye  and  hand  coordination  to 
operate  various  pieces  of  equipment. 


(3).  Once  again,  statistical  analysis  results  showed  that 
867.  of  71Rs  should  come  from  I-IIIA,  14%  should  come  from  1 1  IB, 
and  0%  should  come  from  IV.  The  Public  Affairs  Proponent  Activity 
feels  these  accession  figures  are  not  adequate  due  to 
aforementioned  reasons:  The  SL  1  mix  cannot  fall  below  the 
present  rate  of  98%  from  mental  categories  I-IIIA  and  2%  from 
IIIB  without  creating  a  critical  loss  of  skilled  manpower  for  the 
future. 
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DISTRIBUTION  OF  QUALITY  (DQ)  REPORT 

FOR  73C*  i 

a.  Summary 

<1).  The  required  recruit  accession  quality  mix  -for  730  is  8554 
■for  I-IIIA,  15%  -for  IIIB,  and  0%  for  IV.  i 

(2).  These  quality  accession  standards  are  needed  for  the 
Finance  Corps  to  accomplish  its  CSS  mission  on  the  AirLand 
Battlefield.  Changes  in  structure}  increased  training 
requirements*  increasing  automation  of  functions*  and  doctrinal 
changes  demanding  greater  decision-making*  technical*  and 
J.eadership  responsibilities  are  the  primary  reasons  for  these 
requirements.  The  Finance  Corps  will  provide  support  to  the 
soldier  and  Commander  on  the  battlefield  with  a  totally 
restructured  TOE*  downsized  to  meet  the  Army’s  AOE  requirements. 
This  smaller  structure  and  the  increased  use  of  automation  will 
require  finance  soldiers  to  be  mentally  capable  of  being  trained 
to  become  technically  ana  tactically  proficient  soldiers  who 
support  combat  operations  as  small  independent  teams  on  the 
battlefield. 

b.  Target  Skill  Level 

(1) ,  Skill  level  (SL;  2  (E-5)  was  used.  SL  2  was  selected 

because  this  is  the  most  critical  level  for  mission  success  or  i 
failure  in  the  MOS.  SL  2  becomes  the  first  major  "quality  cut"  of 

the  accession  soldier.  SL  2  soldiers  are  knowledgeable  in  SL  1  ^ 

tasks  and  are  a  close  representation  of  the  accession  soldier. 
Additionally*  they  are  the  first  line  supervisors  in  finance 
units  and  the  lowest  echelon  trainers.  The  quality  mix  of  SL  2 

will  determine  if  the  skill  requirments  of  SLs  3,  4*  and  5  can  be 

met.  Finally*  SL  2  best  represents  the  most  demanding  performance 
requirements  of  the  MOS. 

c.  Performance  measure 

<1).  The  Skill  Qualification  Test  (SQT)  was  used  to  evaluate 
proficiency  in  the  MOS.  The  selection  of  the  SQT  is  based  on  the 
assumption  that  this  measurement  provides  an  acceptable  estimate 
of  performance  of  critical  MOS  tasks.  Furthermore*  the  SQT  was 
used  because  it  provides  a  reliable*  valid  means  of  estimating 
the  ability  to  perform  critical  tasks  at  SL  2. 

(2) .  Content  Validity 

Content  validity  is  the  extent  to  which  a  test  measures  job 
performance  in  the  MOS.  The  SQT  was  systematically  validated  for 
content  by  the  SQT  Branch  of  DOTD  using  a  series  of  rigorous 
checks  and  reviews  outlined  in  TRADOC  Regulation  351-2*  Skill 
Quantification  Test  (SQT)  and  Common  Task  Test  (CTT) 
Development*  Policies*  and  Procedures.  These  procedures  included 

*P0C  for  statistical/research  methodology  is  Dr.  Phillip 
Vandivier  (AV  699-3821 ) . 
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a  review  o-f 
task  test, 
untrained 
standards, 
minimum  passing 
materials. 


the  SQT  task  list,  peer/psychometr ic  review  o-f  each 
expert/murder  board  review,  editorial  review, 
tryout,  soldier  tryout,  setting  task  training 
assigning  final  administration  time  limit,  setting 
score,  and  final  review  of  camera  ready 


(2. ) .  Rel iabi 1 ity 

An  estimate  of  the  internal  reliability  of  the  test  is 
important  to  determine  the  extent  to  which  the  instrument  is 
consistent  (within  itself)  in  measuring  performance.  Two  separate 
procedures,  the  Coefficient  Alpha  and  Kuder-Richardson  method, 
.yere  used  to  estimate  internal  reliability  of  the  SL  2  SQTs 

Coefficient  Alpha  provides  an  estimate  of  the  extent  to 
which  all  test  items  intercorrelate  with  one  another.  A 
coefficient  of  .758  was  obtained. 

The  fiuder-Richardson  procedure  also  provides  an  estimate  of 
the  extent  to  whhich  all  SQT  items  measure  the  same  abilities.  A 
coefficient  of  .812  was  obtained. 

These  results  in  combination  indicate  the  SL  2  73C  SQT  has 
a  moderate  degree  of  internal  reliability. 

d.  Research  Design  and  Implementation 

Cl).  Test  Administration  and  Data  Collection  Procedures 

SQTs  were  administered  lAW  procedures  outlined  in  TRADOC  Reg 
351-2.  Also,  the  Armed  Services  Vocational  Aptitude  Battery 
(ASVAB)  was  administered  upon  soldier  entry  into  the  Army  lAW 
routine  procedures. 

Data  was  extracted  from  official  test  results  obtained  from 
MILPERCEN  with  the  help  of  the  SSC-NCR  Liaison.  Memory 
constraints  on  available  hardware  precluded  the  use  of  all  775 
cases  available.  Final  data  analyses  included  509  cases,  or 
approximately  66%  of  the  available  cases. 

<2) .  Data  analyses  were  conducted  with  the  use  of  the 
Statistical  Package  For  the  Social  Sciences — Personal  Computer 
Plus  package.  Results  are  as  follows* 

(a).  A  stepwise  multiple  regression  procedure  was  conducted 
to  determine  what  combination  of  ASVAB  Aptitude  Areas  CArmed 
Forces  Qualification  Test  (AFQT) ,  Clerical  (CD,  Combat  (CO), 
Electronics  Repair  (EL),  Field  Artillery  (FA),  General 
Maintenance  (GM) ,  Mechanical  Maintenance  (MM) ,  Operators/Food 
(OF),  Surveillance/Communications  (SC),  and  Skilled  Technical 
(SL)  scores]  did  the  best  job  of  predicting  SQT  scores.  Multiple 
regression  is  the  preferred  procedure  used  in  the  behavioral 
sciences  when  the  object  is  to  determine  which  of  several 
combinations  of  predictors  does  the  best  job  of  predicting  a 


single  criterion;  and  to  determine  hov>)  much  weight  each  predictor 
has  in  the  prediction  o-f  the  criterion.  Results  indicated  FA»  OF^ 
and  AFQT  results  together  signi-f icantly  (R=.47;  F=34.01j  p<.01) 
predicted  SQT.  A  total  of  21.7  per  cent  of  the  variance  in  SQT 
scores  was  explained  by  FA,  OF,  and  AFQT  results.  FA  accounted 
for  approximately  19  per  cent  of  the  variance  in  SQT  scores 
(F=86.85;  p<.001),  followed  by  OF  (F=7.47;  p<.01),  and  AFQT 
results  (F=5.1l;  p<.05)  which  accounted  for  additional  increases 
of  1.6  and  1.1  per  cent  in  the  variance  of  SQT  scores, 
respectively.  After  these  three  no  other  variable  or  variables 
contributed  anything  unique  or  significant  to  the  prediction  of 
SQT. 


Although  statistically  significant,  the  strength  of  the 
predictive  relationship  between  FA,  OF,  and  AFQT,  on  the  one 
hand,  and  SQT  scores,  on  the  other,  can  best  be  described  as 
mild!  Although  21.7  per  cent  of  the  variance  in  SQT  scores  was 
explained,  a  total  of  78.3  per  cent  of  SQ"^  variance  remains 
unexplained  by  ASVAB  results. 

Please  note:  Mild  but  statistically  significant  Pearson  r 
correlations  were  found  for  all  other  Aptitude  Area  predictors 
including  ST  (r=+.40;  p<.001>,  SC  <r=+.33|  p<.001),  CL  <r=+.35; 
p<.001),  and  EL  <r=+.35;  p<.001).  (The  large  sample  size 
undoubtedly  contributed  to  the  finding  of  numerous  positive 
correlations  among  Aptitude  Areas.)  Nevertheless,  none  of  these 
variables  significantly  added  to  the  prediction  of  SQT  scores 
above  and  beyond  what  was  provided  by  FA,  OF,  and  AFQT  results. 
(Technically,  none  of  these  variables  made  significant 
contributions  to  the  prediction  of  SQTs  after  FA,  OF,  and  AFQT 
results  were  already  entered  into  the  regression  equation.)  FA, 
OF,  and  AFQT  results  had  Pearson  correlation  coefficients  of 
r=+.44,  +.22,  and  +.34  (all  p<.001),  respectively. 


(b) .  A  t  test  was  computed  to  determine  whether  significant 
differences  exist  between  the  SQT  averages  of  soldiers  in  mental 
category  I-IIIA  (upper  50th  percent)  vs.  IIIB-IV  (10  to  49th 
percent)  on  AFQT  results — which  are  calculated  from  ASVAB 
subtest  results.  The  difference  between  the  average  of  77.74  for 
category  I-IIIA  soldiers  and  the  mean  of  70.58  for  category  IIIB- 
IV  personnel  is  statistically  significant  (t=6.47;  p<.001). 
Nevertheless,  the  difference  of  7. 16  points  between  the  two  in 
practical  terms  is  less  than  overwhelming.  A  followup  Pearson  r 
analysis  indicated  a  mild  but  significant  positive  correlation 
between  the  two  variables  (r=.34;  p<.001>.  These  analyses  provide 
evidence  that  SQT  results  ^  tend  to  increase  with  mental 
category. 

(c) .  A  minimum  passing  SQT  score  of  60  was  determined  by 
subject  matter  experts  at  the  school.  Approximately  9%  of  the  73C 
sample  failed  to  meet  this  performance  standard. 

Next,  a  frequency  distribution  was  made  of  the  percentages 
of  73C5  who  passed  and  failed  (using  the  minimum  passing  SQT 


CD  U  O^tr  UJ  CD 


score)  across  di-f-ferent  mental  categories.  Results  were  as 
■follows: 

PERCENTAGE  OF  PASS/FAILS  BY  MENTAL  CATEGORY 


MENTAL  CATLBORY 


I-IIIA 

IIIB 

IV 

FAIL 

(59  and 

5.87. 

15.67 

9.57 

below) 

n=lS 

n=19 

n=6 

PASS 

(60  and  94.27.  84.47.  90.57. 

above)  n=295  n=103  n=57 


Results  indicate  the  -failure  rate  o-f  67  -for  I-IIIAs  is  less  than 
that  -for  1 1  IBs,  at  167,  and  I  Vs,  at  107.  Conversely,  the  pass 
rate  o-f  947  -for  I-IIIAs  is  greater  than  that  for  1 1  IBs,  at  847, 
and  IVs,  at  917.  Nevertheless,  the  trend  -for  higher  mental 
category  individuals  to  per-form  better  than  lower  -functioning 
soldiers  did  not  hold  up  at  the  lower  intellectual  levels:  IVs 
had  both  a  higher  -frequency  of  passes  and  lower  frequency  of 
failures  than  1 1 IBs. 

<d).  A  simple  frequency  distribution  was  run  to  determine  the 
breakdown  of  soldiers  by  AFQT  mental  categories  in  our  sample. 
Results  indicated  the  following: 


SAMPLE  PERCENTAGES  BY 
AFQT  MENTAL  CATEGORY 

I-IIIA  IIIB  IV 

62.97.  24.57.  12.67. 

n=313  n=122  n=63 


These  percentages  provide  an  approximate  estimate  of  the  present 
mental  category  breakdown  for  73Cs  at  SL  2. 

(e) .  In  order  to  determine  future  73C  accession  requirements, 
the  following  steps  were  taken  CNDTE:  These  steps  are  outlined  in 
Appendix  Gof  the  Distribution  of  Quality  Program  Handbook^: 

(1).  A  frequency  distribution  was  made  of  CL  scores.  CL 
results  were  used  because  a  minimum  CL  score  is  required  for 
entry  into  the  MOS. 

<2> .  The  frequency  distribution  of  CL  scores  was 
converted  to  an  approximate  mental  category  distribution  using 
tables  and  procedures  outlined  in  the  Distribution  of  Quality 
Program  Handbook.  CNOTE:  The  frequencies  of  soldiers  which  fell 
within  each  5-point  CL  score  category  were  multiplied  by  separate 
factors  for  each  mental  category  which  converted  CL  results  into 
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an 


estimated  -frequency  distribution  of  soldiers  by  mental 
category.  Please  refer  to  Appendix  6  of  the  Distribution  of 
Quality  Program  Handbook  for  further  clarification  and  examples 
of  this  procedure. 3 

(3)  .  Percentages  for  each  mental  category  were 
determined  by  dividing  the  frequencies  of  sums  for  each  category 
by  the  overall  total  for  all  categories.  (Percentages  were  79.5 
for  category  I-IIIA;  19.0  for  I I IB;  and  1.5  for  IV.) 

(4) .  Each  mental  category  percentage  was  divided  by  a 
factor  which  controls  for  historical  continuation/survival  rates! 


I-IIIA:  80/. 1589  =  503.46 

^  IIIB  :  19/. 2203  =  86.25 

IV  :  1/.2252  =  4.44 


Total  =  594. i5 

(5) .  Final  future  accession  rates  were  determined  by 
dividing  each  of  these  results  by  the  totals 

I-IIIA:  503.46/594.15  =  84.77. 

1 1  IBs  86.25/594.15  =  14.57. 

IV:  4.44/594.15  =  .87. 

e.  Conclusions  and  recommendations 

(1).  In  conclusion»  this  study  found  that: 

(a) .  Field  Artilleryi  Operators/Food^  and  Armed  Forces 
Qualification  Test  Results  did  the  best  job*  in  that  order*  of 
predicting  soldier  performance  on  the  73C  SL  2  SQT. 

(b)  .  Overall  results  suggest  SL  2  73Cs  in  higher  mental 
categories  tend  to  score  higher  on  the  SQT  than  those  in  lower 
mental  categories;  however*  at  least  some  of  the  data  suggest 
that  mental  category  IV  soldiers  did  slightly  better  than  XXIBs. 

<c).  Approximately  62.9  per  cent  of  73Cs  presently,  are  in 
mental  categories  I-IIIA*  24.5  per  cent  are  from  I I IB;  and  12.6 
per  cent  are  from  IV. 

<d) .  According  to  statistical  analysis  results*  85  per 
cent  of  future  73Cs  should  come  from  mental  category  I-IIIA*  15 
per  cent  should  come  from  IIIB*  and  0  per  cent  should  come  from 
IV. 

(e) .  RECOMMEND  the  use  of  the  following  multiple 
regression  equation  which  uses  Field  Artillery*  Foods/Operators* 
and  Armed  Forces  Qualification  Test  results  to  predict  success  of 
future  73C  recruits  on  the  SQT: 

C.3678)  X  (FA)  +  (-.1304)  x  (FO)  +  (.0617)  x  (AFQT)  +  45.47  * 

Predicted  SQT 
Score 

EXAMPLE: 

(.3678)  X  (85)  +  (-.1304)  x  (80)  +  (.0617)  x  (82)  45.47  =  71.36 

Any  score  which  falls  within  10  points  of  the  SQT  cutoff  (60) 
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indicates  an  individual  who  is  at  high  risk  for  failing  the  SL  2 
SQT.  For  e5<ample»  a  recruit  who  scores  35»  SO,  and  82  on  the  FA, 

FO,  and  AFQT,  respectively,  obtains  a  predicted  SQT  score  of 
71.36 — which  is  not  within  10  points  of  the  cutoff  <60) ; 
therefore,  this  soldier  is  not  high  risk  for  failure  on  the  73C 
SQT.  Please  note:  High-risk  individuals  who  are  motivated  and 
interested  in  a  73C  career  might  try  hard  and  be  fully 
successful  on  the  SL  2  SQT;  nevertheless,  in  the  long  run  more 
high-risk  soldiers  will  have  trouble  with  SQTs  than  nonhigh-risk 
individuals, 

(9) .  RECOMMEND  that  further  studies  be  conducted  to 
determine  the  extent  to  which  CL  scores  as  presently  configured 
should  continue  to  be  used  as  a  standard  for  accession  into  the 
73C  MOS.  This  recommendation  is  based  on  the  finding  that  other 
£pt  itude  Areas — but  especially  FA — did  a  better  job  of  predicting  | 
SL  2  73C  SQTs  than  did  CL  scores.  Part  of  the  reason  for  this 
finding  is  that  the  Aptitude  Area  Composite  scores  include 
overlapping  ASVAB  subtest  scores.  For  example,  FA  includes  two  of 
the  three  subtest  scores  which  are  summed  to  derive  CL  results. 
This  fact — plus  the  fact  that  FA  contains  two  subtests  which 
measure  arithmetic  knowledge  and  reasoning — largely  explains  the 
seemingly  illogical  finding  that  FA  scores  do  a  better  job  of 
predicting  SL  2  73C  SQTs  than  CL  scores.  Nevertheless,  one  would 
expect  that  CL  should  be  the  best  predictor  if  it  is  to  be  used 
as  a  standard  for  accession  into  73C.  For  this  reason,  studies 
should  be  conducted  to  determine  whether  and  how  the  CL  Aptitude  | 
Area  score  needs  to  be  reconfigured  so  it  will  do  a  better  job  of  J 
predicting  success  on  the  SL  73C  SQT. 

(2) .  The  required  recruit  accession  quality  mix  for  73C  is 
needed  for  the  Finance  Corps  to  accomplish  its  combat  service 
support  mission  on  the  AirLand  Battlefield.  Doctrinal  changes, 
increased  training  requirements  for  technical  and  battlefield 
skills,  and  the  fielding  of  more  and  more  automation  equipment 
drive  the  need  for  high  quality  soldiers.  Finance  units  are 
structured  leaner  in  terms  of  the  number  of  authorized  personel 
than  ever  before.  But  the  CSS  mission  makes  greater  demands  on 
these  personnel  than  in  the  past.  While  automation  advances  and 
enhancements  reduce  "stubby  pencil"  work,  the  decision-making 
responsibilities  and  leadership  requirements  demand  a  higher 
quality  soldier  than  might  be  otherwise  supposed.  Additionally, 
when  battlefield  conditions  make  the  automation  equipment 
nonoperational,  the  quality  soldier  will  be  able  to  continue  with 
the  successful  completion  of  the  mission. 

(3) .  Because  of  the  above  drivers,  the  quality  accession  SL 
2  mix  cannot  be  less  than  the  results  of  statistical  analysis  in 
para  e(l)(d)  above!  855i  for  I-IIIA;  15%  for  IIIBl  and  0%  for  IV. 
Any  reduction  from  this  standard  will  seriously  degrade  the 
Finance  Corps’  ability  to  support  the  soldier  and  Commander  on 
the  battlefield. 
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29  Sep  87 

DISTRIBUTION  OF  QUALITY  <DQ)  REPORT 
FOR  73B* 


a.  Summary 

<1).  The  required  recruit  accession  quality  mix  -for  73D  is  89% 
for  I-IIIA,  10%  -for  1 1  IB,  and  1%  -for  IV. 

<2) .  These  quality  accession  standards  are  needed  for  the 
Finance  Corps  to  accomplish  its  CSS  mission  on  the  AirLand 
Battlefield.  Changes  in  structure,  increased  training 
requirements,  increasing  automation  of  functions,  and  doctrinal 
changes  demanding  greater  decision-making,  technical,  and 
Readership  responsibilities  are  the  primary  reasons  for  these 
requirements.  The  Finance  Corps  will  provide  support  to  the 
soldier  and  Commander  on  the  battlefield  with  a  totally 
restructured  TOE,  downsized  to  meet  the  Army’s  AOE  requirements. 
This  smaller  structure  and  the  increased  use  of  automation  will 
require  finance  soldiers  to  be  mentally  capaole  of  being  trained 
to  become  technically  and  tactically  proficient  soldiers  who 
support  combat  operations  as  small  independent  teams  on  the 
battlefield. 

b.  Target  Skill  Level 

(t).  Skill  level  (SL)  2  (E-5>  was  used.  SL  2  was  selected 

because  this  is  the  most  critical  level  for  mission  success  or 

failure  in  the  MOS.  SL  2  becomes  the  first  major  "quality  cut"  of 
the  accession  soldier.  SL  2  soldiers  are  knowledgeable  in  SL  1 
tasks  and  are  a  close  representation  of  the  accession  soldier. 
Additionally,  they  are  the  first  line  supervisors  in  finance 
units  and  the  lowest  echelon  trainers.  The  quality  mix  of  SL  2 

will  determine  if  the  skill  requirments  of  SLs  3,  4,  and  5  can  be 

met.  Finally,  SL  2  best  represents  the  most  demanding  performance 
requirements  of  the  MOS. 

c.  Performance  measure 

<1).  The  Skill  Qualification  Test  (SQT)  was  used  to  evaluate 
proficiency  in  the  MOS.  The  selection  of  the  SQT  is  based  on  the 
assumption  that  this  measurement  provides  an  acceptable  estimate 
of  performance  of  critical  MOS  tasks.  Furthermore,  the  SQT  was 
used  because  it  provides  a  reliable,  valid  means  of  estimating 
the  ability  to  perform  critical  tasks  at  SL  2. 

(2).  Content  Validity 

Content  validity  is  the  extent  to  which  a  test  measures  job 
performance  in  the  MOS.  The  SQT  was  systematically  validated  for 
content  by  the  SQT  Branch  of  DOTD  using  a  series  of  rigorous 
checks  and  reviews  outlined  in  TRADOC  Regulation  351-2,  Skill 
Quantification  Test  (SQT)  and  Common  Task  Test  (CTT) 
Development,  Policies,  and  Procedures.  These  procedures  included 
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a  review  the  SQT  task  list 5  peer /psychometric  review  of  each 
task  test,  expert/murder  board  review,  editorial  review, 
untrained  tryout,  soldier  tryout,  setting  task  training 
standards,  assigning  final  administration  time  limit,  setting 
minimum  passing  score,  and  final  review  of  camera  ready 
materials. 

(2.).  Reliability 

An  estimate  of  the  internal  reliability  of  the  test  is 
important  to  determine  the  extent  to  which  the  instrument  is 
consistent  (within  itself)  in  measuring  performance.  Both  the 
Coefficient  Alpha  and  Kudei — Richardson  techniques  were  used  to 
estimate  the  reliability  of  the  SL  2  73D  SQT, 

Coefficient  Alpha  provides  an  estimate  of  the  extent  to 
which  all  test  items  intercorrelate  with  one  another.  A 
coefficient  of  .844  was  obtained. 

The  Kuder-Richardson  procedure  also  provides  an  estimate  of 
the  extent  to  which  test  items  are  measuring  the  same  thing.  A 
coefficient  of  .797  was  obtained. 

i 

These  results  together  suggest  the  SL  2  73D  SQT  has  a 
moderate  to  high  amount  of  internal  consistency  or  reliability.  j 

i 

t 

d.  Research  Design  and  Implementation 

Cl).  Test  Administration  and  Data  Collection  Procedures 

SQTs  were  administered  lAW  procedures  outlined  in  TRADOC  Reg 
351-2.  Also,  the  Armed  Services  Vocational  Aptitude  Battery 
(ASVAB)  was  administered  upon  soldier  entry  into  the  Army  lAW 
routine  procedures. 

Data  was  extracted  from  official  test  results  obtained  from 
tllLPERCEN  with  the  help  of  the  SSC-NCR  Liaison.  Ail  126  cases 
available  (the  entire  population  of  SL  2  73Ds)  ir;ere  used  for  data 
analyses. 

<2).  Data  analyses  were  conducted  with  the  use  of  the 
Statistical  Package  For  the  Social  Sciences — Personal  Computer 
Plus  package.  Results  are  as  follows: 

(a).  A  stepwise  multiple  regression  procedure  was  conducted 
to  determine  what  combination  of  ASVAB  Aptitude  Areas  CArmed 
Forces  Qualif icaticn  Test  CAFQT) ,  Clerical  (CL)  ,  Combat  <C0) , 
Electronics  Repair  (EL),  Field  Artillery  (FA),  General 
Maintenance  (BM) ,  Mechanical  Maintenance  (MM) ,  Operators/Food 
(OF),  Surveillance/Communications  (SC),  and  Skilled  Technical 
(ST)  scores!  did  the  best  job  of  predicting  SQT  scores.  Multiple 
regression  is  the  preferred  procedure  used  in  the  behavioral 
sciences  when  the  object  is  to  determine  which  of  several 
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combinations  a-f  predictors  does  the  best  job  o-f  predicting  a 
single  c  iterion;  and  to  determine  how  much  weight  each  predictor 
has  in  the  prediction  o-f  the  criterion.  Results  indicated  SC 
sign  1 -f  icant  ly  (r=-t-..36;  p<.001)  predicted  SQT.  Although  the 

relationship  was  statistically  sign i -f icant ,  the  magnitude  or 
strength  of  i,he  relationship  could  best  be  described  as  weak!  SC 
explained  12.9  per  cent  o-f  the  variance  in  SQTs — but  87.1  per 
cent  remains  unexplained  by  ASVAB  results.  No  other  variable  or 
variables  contributed  signi-f icantly  to  the  prediction  o-f  SQTs 
above  and  beyond  that  which  was  provided  by  SC.  (Technically?  no 
other  variable  provided  signi-ficant  contribution  to  the 
prediction  o-f  SQTs  a-fter  SC  was  already  entered  in  the  regression 
equation.)  For  this  reason?  results  were  reduced  to  a  Pearson  r 
between  SC  and  SQTs. 

Please  note:  Pearson  r  results  indicated  several  other  variables 
significantly  predict  SL  2  SQTs  to  a  lesser  extent  than  SC? 
including  CL  <r=-t-.30?  p<.01)?  ST  (r=-<-.29?  p<.01)?  AFQT  (r=+.28? 

p<.01)?  and  CO  <r=-»-.26?  p<.01).  None  of  the  other 

intercorrelations  were  significant. 

(b)  .  A  t  test  was  computed  to  determine  whether  significant 

differences  exist  between  the  SQT  averages  of  soldiers  in  mental 
category  I-IIIA  (upper  50th  percent)  vs.  1 1  IB  (10  to  49th 
percent)  on  AFQT  results — which  are  calculated  from  ASVAB 

subtest  results.  The  difference  of  9.01  points  between  the 
average  of  78.40  for  category  I-IIIA  soldiers  and  the  mean  of 
69.39  for  category  IIIB  personnel  is  statistically  significant 
(t=3.42;  p<.001).  A  followup  Pearson  r  analysis  indicated  a  mild 
but  significant  positive  correlation  between  the  two  variables 
(r=-+-.28?  p-<.01).  These  analyses  provide  evidence  that  SQT  results 
do  tend  to  increase  with  mental  category. 

(c)  .  A  minimum  passing  SQT  score  of  60  was  determined  by 
subject  matter  experts  at  the  school.  Approximately  11/C  of  the 
73D  sample  failed  to  meet  this  performance  standard. 

Next?  a  frequency  distribution  was  made  of  the  percentages 
of  73Ds  who  passed  and  failed  (using  the  minimum  passing  SQT 
score)  across  different  mental  categories.  Results  were  as 
f ol lows! 


PERCENTAGE  OF  PASS/FAILS  BY  MENTAL  CATEGORY 

MENTAL  CATEGORY 


I-IIIA  IIIB  IV 

S 

0  FAIL 

T  (59  and  b.6V.  21.4'/.  40.0-/. 

below)  n=6  n=6  n=2 

S  _ 

C  PASS 

0  (60  and  93.47.  78.67.  60.07. 

R  above)  n=85  n=22  n=3 

E  _ _ 

.  ^ 

Because  of  the  small  number  of  mental  category  IV  cases  (5), 
these  results  must  be  interpreted  with  caution.  With  this  fact  in 
mind,  results  indicate  that  the  failure  rate  increases  from  77 
for  I-IIIAs  to  217  for  1 1  IBs  to  407  for  IVs.  Conversely,  the 
pass  rates  gradually  decrease  from  937  for  I-IIIAs  to  797.  for 
1 1  IBs  to  607.  for  IVs. 

(d).  A  simple  frequency  distribution  was  run  to  determine  the 
breakdown  of  soldiers  by  AFQT  mental  categories  in  our  sample. 
Results  indicated  the  following: 


SAMPLE  PERCENTAGES  BY 
AFQT  MENTAL  CATEGORY 

I-IIIA  IIIB  IV 

73.47.  22.67.  4.07. 

n=91  0=28  n=5 


These  percentages  provide  an  approximate  estimate  of  the  present  j 
mental  category  breakdown  for  73Ds  at  SL  2.  ! 

j 

(e) .  In  order  to  determine  future  73D  accession  requirements,  j 
the  following  steps  were  taken  CNOTE:  These  steps  are  outlined  in  I 
Appendix  G  of  the  Distribution  of  Quality  Program  Handbook]:  | 

(1).  A  frequency  distribution  was  made  of  CL  scores.  CL 
results  were  used  because  a  minimum  CL  score  is  required  for  | 

entry  into  the  MOS.  | 

(2) .  The  frequency  distribution  of  CL  scores  was  | 

converted  to  an  approximate  mental  category  distribution  using  | 
tables  and  procedures  outlined  in  the  Distribution  of  Quality  1 
Program  Handbook.  CNOTE:  The  frequencies  of  soldiers  which  fell  | 
within  each  5-point  CL  score  category  were  multiplied  by  separate 
factors  for  each  mental  category  which  converted  CL  results  into  | 
an  estimated  frequency  distribution  of  soldiers  by  mental  ] 
category.  Please  refer  to  Appendix  G  of  the  Distribution  of  | 
Quality  Program  Handbook  for  further  clarification  and  examples  | 
of  this  procedure. 3  I 

(3)  .  Percentages  for  each  mental  category  were  | 
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determined  by  dividing  the  frequencies  of  sums  for  each  category 
by  the  overall  total  for  all  categories.  (Percentages  were  85.4 
for  category  I-IIIA|  13.3  for  IIIB;  and  1.3  for  IV.) 

(4).  Each  mental  category  percentage  was  divided  by  a 
factor  which  controls  for  historical  continuation/survival  rates! 


I-IIIA!  85/. 1589=  534.93 
IIIB  :  13/. 2203  =  59.01 
IV  :  1/.2252  =  4.44 


Total  =  598.38 

<S) .  Final  future  accession  rates  were  determined  by 
dividing  each  of  these  results  by  the  totals 

I-IIIA:  534.93/598.38  =  89.4*/. 

IIIB:  59.01/598.38  =  9.9*/. 

IV:  4.44/598.38  =  .7*/. 

e.  Conclusions  and  recommendations 

(1).  In  conclusion?  this  study  found  that: 

(a).  Survei 1 lance/Communicat ion  results  did  the  best  job 
of  predicting  soldier  performance  on  the  73D  SL  2  3QT .  No  other 
variable  contributed  to  the  prediction  of  SQTs  above  and  beyond 
what  was  provided  by  Surveillance/Communication. 

<b>.  Overall  results  suggest  73Ds  in  higher  mental 
categories  tend  to  score  higher  on  the  SL  2  SQT  than  those  in 
lower  mental  categories. 

(c>.  Approximately  73.4  per  cent  of  73Ds  presently  are  in 
mental  categories  I-IIIA?  22.6  per  cent  are  from  IIIB?  and  4.0 
per  cent  are  from  IV. 

(d>.  According  to  statistical  analysis  results?  89  per 
cent  of  future  73Ds  should  come  from  mental  category  I-IIIA?  10 
per  cent  should  come  from  IIIB?  and  1  per  cent  should  come  from 
IV. 

(e) .  RECOMMEND  the  use  of  the  following  multiple 
regression  equation  which  uses  Surveillance/Communications 
results  to  predict  success  of  future  73D  recruits  on  the  SL  2 
SQT: 

(.2665)  ;<  (SC)  +  48.70  =  Predicted  SQT  Score 
EXAMPLE: 

(.2665)  X  (85)  +  48.70  =  71.35 

Any  predicted  SQT  score  which  falls  within  10  points  of  the  SQT 
cutoff  (60)  indicates  an  individual  with  high  risk  for  failure  on 
the  SL  2  73D  SQT.  For  example?  a  recruit  who  scores  85  on  SC 
obtains  a  predicted  SQT  score  of  71.35 — which  is  not  within  10 
points  of  the  cutoff  (60)?  therefore?  this  soldier  is  not  high 
risk  for  failure  on  the  73D  SQT.  Please  note*  High-risk 
individuals  who  are  motivated  and  interested  in  a  73D  career 
might  try  hard  and  be  fully  successful  on  the  SQT?  nevertheless? 
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in  the  long  run  more  high-risk  soldiers  will  have  trouble  with 
SQTs  than  nonhigh-r isk  individuals. 

(9) .  RECOMMEND  that  further  studies  be  conducted  to  J 
determine  the  extent  to  which  CL  scores  as  presently  configured  ; 
should  continue  to  be  used  as  a  standard  for  accession  into  the  j 
73D  MOS.  This  recommendation  is  based  on  the  finding  that  SC 
results  did  a  better  job  of  predicting  SL  2  73D  SQTs  than  did  CL. 
Part  of  the  reason  for  this  finding  is  that  the  Aptitude  Area 
Composite  scores  include  overlapping  ASVAB  subtest  scores.  For 
examp le»  SC  includes  two  of  the  three  subtest  scores  which  are  I 
summed  to  derive  CL  results.  This  fact  largely  explains  the  1 
seemingly  illogical  finding  that  SC  does  a  better  job  of  | 
predicting  SL  2  73D  SQTs  than  CL  scores.  Nevertheless  one  would  J 
expect  that  CL  scores  should  be  the  best  predictor  if  it  is  to  be  i 
used  as  a  standard  for  accession  into  73D.  For  this  reasoni 
studies  should  be  conducted  to  determine  whether  and  how  the  CL 
Aptitude  Area  score  needs  to  be  reconfigured  so  it  will  do  a 
better  job  of  predicting  success  on  the  SL  2  73D  SQT . 

(2) .  The  required  recruit  accession  quality  mix  for  73D  is 
needed  for  the  Finance  Corps  to  accomplish  its  combat  service 
support  mission  on  the  AirLand  Battlefield.  Doctrinal  changes? 
increased  training  requirements  for  technical  and  battlefield 
skills?  and  the  fielding  of  more  and  more  automation  equipment 
drive  the  need  for  high  quality  soldiers.  Finance  units  are 
structured  leaner  in  terms  of  the  number  of  authorised  persons 1 
than  ever  before.  But  the  CSS  mission  makes  greater  demands  on 
these  personnel  than  in  the  past.  While  automation  advances  and 
enhancements  reduce  "stubby  pencil"  work?  the  decision-making 
responsibilities  and  leadership  requirements  demand  a  higher 
quality  soldier  than  might  be  otherwise  supposed.  Additionally? 
when  battlefield  conditions  make  the  automation  equipment 
nonoperat ional ?  the  quality  soldier  will  be  able  to  continue  with 
the  successful  completion  of  the  mission. 

(3) .  Because  of  the  above  drivers?  the  quality  accession  SL 
2  mix  cannot  be  less  than  that  indicated  by  statistical  analysis 
results  in  par-a  e(l)<d):  8954  for  I-IIIA?  1054  for  IIIB?  and  154  for 
IV.  Any  reduction  from  this  standard  will  seriously  degrade  the 
Finance  Corps’  ability  to  support  the  soldier  and  Commander  on 
the  battlefield. 
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DISTRIBUTION  OF  QUALITY  (DQ)  REPORT 
FOR  71L* 

■5.  Summary 

(1) .  "he  Adjutiint  General  School's  position  on  what  the 
required  reci'uit  accession  quality  mix  should  be  -For  71Ls  is 
82.4%  From  mental  categories  I-IIIA;  16.  3%  -from  category  1 1  IB? 
and  1.3%  -from  category  IV. 

(2) .  The  accession  quality  mix  for  "^ILs  needs  to  be  upgraded 
from  the  present  figures  of  56%  from  I--IIIA,  35%  from  1 1  IB,  and 
9%  from  IV  because  higher  quality  soldiers  are  needed  to  be  able 
to  meet  the  future  cnallenge  of  fully  automated  (computerized) 
^.dmi  nistrative  duties.  Until  quite  recently,  71Ls  were  trained  on 
the  use  of  basic  typewriters;  however,  present  training  requires 
recruits  who  are  capable  of  learning  and  operating  automated  word 
processors  ana  computers.  This  trend,  which  will  continue  in  the 
future,  dsmarcs  a  much  higher  caliber  soldier  than  in  the  tpast. 


b.  Target  Ukill  Level 

''1).  Gkill  Level  (SL)  3  (E-6>  was  used.  SL  3  was  selected 
because  this  .s  the  level  of  most  section  chiefs  in  this  MOS 
throughout  t.-.e  Ai'my.  For  this  reason,  performance  of  SL  3 
soldiers  is  critical  for  mission  success. 

c.  Performance  measure 

(1).  The  Skill  Qualification  Test  (SQT)  was  used  to  evaluate 
proficiency  in  the  NOS.  The  selection  of  the  SQT  is  based  on  the 
assumption  that  this  measurement  provides  an  acceptable  estimate 
of  performance  of  critical  NOS  tasks.  Furthermore,  the  SQT  was 
used  because  it  provides  a  reliable,  valid  means  of  estimating 
the  ability  to  perform  critical  tasks  at  SL  3. 

(2).  Content  'v'alioity 

Content  validity  is  the  extent  to  which  a  test  measures  job 
performance  in  the  MQS.  The  SQT  was  systematically  validated  for 
content  by  the  SQT  Branch  of  DOTD  using  a  series  of  rigorous 
checks  and  reviews  outlined  in  TRADOC  Regulation  351-2,  Skill 
Quantification  Test  (SQT)  and  Common  Task  Test  (CTT) 
Development,  "’olicies,  and  Procedures.  These  procedures  included 
a  review  of  the  SQT  task  list,  peer/psychometr ic  review  of  each 
task  test,  expert/murder  board  review,  editorial  review, 
untrained  tryout,  soldier  tryout,  setting  task  training 
standards,  assigning  final  administration  time  limit,  setting 
minimum  passing  score,  and  final  review  of  camera  ready 
materials. 
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An  estimste  of  the  internal  reliaoility  o-f  the  test  is 
important  to  ostermine  the  extent  to  which  the  instrument  is 
consistent  <within  itsei-)  in  measuring  per-formance.  The 
Coe-f  +  icienr  Alpha  procedure  was  used  to  estimate  the  reliability 
of  the  ""IL  fTQT,  Coettxcient  Alpha  provides  an  estimate  ot  the 
extent  to  whicn  all  test  items  intercorrelate  with  one  .another.  A 
coef-ficient  of  .3359  was  obtained,  whicn  indicates  the  71L  GQT 
has  a  modef'ate,  or  acceptable  amount  of  internal  reliability. 


d.  Research  Design  and  Implementation 

^  -1).  Test  Administration  and  Data  Collection  Procedures 

SOTs  were  admin i stereo  lAUI  procedures  outlined  in  TRADOC  Reg 
351-2.  Also,  the  Armed  Cervices  ^’ocationai  Aptitude  Battery 
■ASVAE')  Nas  admin  i  stered  u.Pon  soldier  enti'v  into  the  Asrmy  'AW 
■■'ou  c  me  pr oc; eo'jr  5s  . 

Data  was  extr-acted  -from  o-«--ficia.i  test  cotained  from 
MILPERCEN  .-jitn  the  r-eip  ot  the  33C-NCF:  Liaison,  The  entire 
population  of  CL  3  71Ls  was  used;  hov^ever,  computation 
requirements  necessitated  the  elimination  of  some  records  because 
of  incomplete  data. 

(2) .  Data  analyses  were  conducted  with  the  use  of  the 
Statistical  Package  For  the  Social  Sciences — Personal  Computer 
Plus  package.  Results  are  as  followss 

(a).  A  stepwise  multiple  regression  procedure  was  conducted 
to  determine  what  combination  of  ASVAB  predictor  variables  (Armed 
Forces  Qualification  Test,  Clerical,  Army  Combat,  Electronics, 
Field  Artillery,  General  Maintenance,  Mechanical  Maintenance, 
□per ators/Food,  Surveillance/Communications,  and  Skilled 
Technical  scores)  did  tne  best  job  of  predicting  SQT  scares. 
Multiple  regression  is  the  preferred  procedure  used  in  the 
behavioral  sciences  when  the  object  is  to  determine  which  of 
several  combinations  of  predictors  does  the  best  job  of 
predicting  a  single  criterion;  and  to  determine  how  much  weight 
each  predictor  has  in  the  prediction  of  the  criterion.  Results 
indicated  the  Skilled  Technician  and  Field  Artillery  results 
together  significantly  <R=  .33;  F=13.75;  p<.001)  predicted  SGIT.  A 
total  of  10.64  per  cent  of  the  variance  in  SQT  scores  was 
explained  by  Skilled  Technician  and  Field  Artillery  results. 
Skilled  Technician  results  accounted  for  approximately  8.33  per 
cent  of  the  variance  in  SQT  scores  (F=21.10;  p<.001),  followed  by 
Field  Artillery  (F=5.95;  p<.05),  which  accounted  for  the 
remainin.g  2.31  per  cent  of  the  variability  in  SQT  scores.  After 
these  two  no  other  variable  or  variables  contributed 
significantly  to  the  prediction  of  SQT. 

Although  statistically  significant,  the  strength  of  the 
predictive  relationship  between  Skilled  Technician  and  Field 
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Artillery  !-esults<  on  the  one  handi  and  SQT  scores,  on  the  other, 
can  best  be  described  as  mild:  Although  10.64  per  cent  of  the 
variance  in  SOT  scores  was  explained,  a  total  of  89.36  per  cent 
of  SQT  variance  ''smains  unexplained  by  A3VAB  scores. 

Please  no-ce:  Mild  but  stat  ist  ical  ly  significant  Pearson  r 
correlations  ^^ith  GOTs  were  founa  for  several  other  predictor 
variables,  including  Survei 1 lance/Communicat ions  <r=  +.25, 

p<.001),  Clerical  ^r=  i-.25,  px.OOI),  and  Armed  Forces 

Qualification  Test  i'esul  bs  '^r=  +.23,  p<.001).  Nevertheless,  none 

of  these  variables  significantly  added  to  the  prediction  of  SQT 
scores  above  and  beyona  what  was  provided  by  Skilled  Technical 
and  Field  Artillery  scores.  (Technically,  none  of  these  variables 
made  significant  contributions  to  tne  prediction  of  SQTs  after 
^killed  Technical  and  Field  Artillery  scores  were  already  entered 
into  the  ''egression  equation.)  Skilled  Technical  and  Field 
Artillery  scores  had  Pearson  r  correlations  of  -*-.29  <p<.001)  and 
+  .27  (p<!.C'M)  ‘j-iith  SQTs,  respect iv'eiy. 

j 

•b>.  -  :  test  y-as  computso  tc  determine  whefer  significant  | 

tifferencss  exist  between  the  SST  averages  of  soldiers  in  mental  I 
category  I-IIIA  ^upper  50th  percent)  vs.  IIIB-IV  '10  to  49th  | 
percent)  on  Armeo  forces  Qualification  Test  results — which  are  j 
calculated  i'rom  ASVAB  subtest  results.  The  difference  between  the  | 
average  of  35.89  for  category  I-IIIA  soldiers  and  the  mean  of  ■ 
32.49  for  category  IIIaE-i-IV  personnel  is  statistically  ; 
significant  (t=2.25;  p<.05).  Nevertheless,  the  difference  of 

3.40  between  the  two  in  practical  terms  is  less  than 

overwhelming.  A  followup  Pearson  r  analysis  indicated  a  mild  but 
significant  positive  correlation  between  the  two  variables 
(r=.23;  p<.001).  These  analyses  provide  supporting  evidence  that  i 

SQT  results  ^  tend  to  increase  with  mental  category. 

<c) .  A  minimum  passing  SQT  score  of  60  was  determined  by 
subject  matter  experts  at  the  school.  Approximately  3%  of  the  71L 
sample  failed  to  meet  this  performance  standard. 

Next,  a  frequency  distribution  was  made  of  the  percentages 
of  71Ls  who  passed  and  failed  (using  the  minimum  passing  SQT 
score)  across  different  mental  categories.  Results  were  as 
follows:  I 


PERCENTAGE  QP  RASS/FAIL5  BY  MENTAL  CATEGORY 


MENTAL  CATEGORY 


I-IIIA  IIIB  IV 

Q  FAIL 
T  <59  and 
below) 


n=4 


n=l 


C  PASS 
0  <oO  and 
R  above) 


c. 


96.9%  97.57.  •  95.27. 

n=123  n=79  n=20 


The  email  nijmber  of  failuree  precluded  'che  emergence  of  a.  pattern 
fegardinq  pas=e=/f ai lures  as  a  function  of  mental  category. 
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e  f 'equency  di str ■ out  ion  was  run  to  determine  the 
oidiers  oy  mFOT  rriental  categories  in  our  sample, 
ed  the  'ol lowing: 


SAMPL 

.E  PERCENTAGES  BY 

AFQT 

MENTAL  CATEGORY 

I-IIIA 

IIIB 

IV 

crc  crv 

m  'aJ  /• 

35.47. 

9.27. 

n=127 

n=31 

n=21 

These  percentages  provide  an  approximate  estimate  of  the  present 
mental  category  breakdown  for  71Ls. 

(e) .  In  order  to  determine  future  71L  accession  requirements* 
the  following  steps  were  taken  CNOTEJ  These  steps  are  outlined  in 
Appendix  G  of  the  Distribution  of  Quality  Program  Handbook! s 

(1).  A  frequency  distribution  was  made  of  Clerical 
scores.  Clerical  results  were  used  because  a  minimum  Clerical 
score  is  required  for  entry  into  the  MOS. 

(2).  The  frequency  distribution  of  Clerical  scores  was 
converted  to  an  approximate  mental  category  distribution  using 
tables  and  procedures  outlined  in  the  Distribution  of  Quality 
Program  Handbook.  CNOTEs  The  frequencies  of  soldiers  which  fell 
within  each  5-point  Skilled  Technical  score  category  were 
multiplied  by  separate  factors  for  each  mental  category  which 
converted  Clerical  results  into  an  estimated  frequency 
distribution  of  soldiers  by  mental  category.  Please  refer  to 
Appendix  G  of  the  Distribution  of  Quality  Program  Handbook  for 
further  clarification  and  examples  of  this  procedure. 3 

(3) .  Percentages  for  each  mental  category  were 
determined  by  dividing  the  frequencies  of  sums  for  each  category 


by  the  Dverall  total  -for  all  categories.  (Percentages  were  76vQ 
for  category  I-IIIA?  21.9  -for  IIIB5  and  2.1  tor  IV.) 

(4) .  Each  mental  category  percentage  was  divided  by  a; 
factor  which  controls  for  historical  continuation/survival  rates! 


IIIB 

IV 


/  .  1  — 
22/. 1543  = 
2/. 1739  = 


71S. 34 
142.53 
11.  13 


Total 


=  372. 10 


^  (5) .  Final  future  accession  rates  were  determined  by 

dividing  each  of  these  results  by  the  total: 


I  - 1 1 1 A : 
( I  IB: 
IV: 


142.53/372. 10 


—  a  •r /» 

=  16.37. 
=  1 . 3/1 


s.  Conclusions  and  recommendations 


(1)  . 

best  job 

somewhat 

mental 
per  cent 

cent  of 
per  cent 
IV. 

regress! 
Art  i  Her 
the  SQT: 


In  conclusion,  this  study  found  t^■^t! 

(a).  Skilled  Technical  and  Field  ArVillery  scores  do  the 
,  in  that  order,  of  predicting. roldier  performance. 

<b).  71Ls  in  higher  mental  categorres  tend  to  score 
higher  on  the  SQT  than  those  in  lower  mental  categories. 

55.5  per  cent  of  71L3  presently  are  in 
35.4  per  cent  are  from  I1IB$  and  9.2 


(c).  Approximately 
categories  I-IIIAj 
are  from  IV. 

(d> .  According  to 
future  71Ls  should 
should  come  from  1 


statistical  analysis  results,  32.4  per 
come  from  mental  category  I-IIIAI  16.3 
IIB5  and  1.3  per  cent  should  come  from 


(e) .  RECOMMEND  the  use  of  the  following  multiple 
on  eguation.  which  uses  Skill  Technician  arid  Field 
results  to  predict  success  of  future  71L  recruits  on 


(.1562)  :<  (ST)  +  (.1132)  k  <FA)  +  56.37  =  Predicted  SQT  Score 


EXAMPLE! 
(.1562)  : 


(85) 


(.1132) 


(80)  +  56.37  =  78.7 


Any  predicted  SQT  score  which  falls  within  11  points  of  the  SQT 
cutoff  (73)  indicates  a  high-risk  individual.  For  example,  a 
recruit  who  scares  S5  and  80  on  the  (ST)  and  (FA),  respectively, 
obtains  a  predicted  score  of  78.7 — which  is  within  11  points  of 
the  cutoff;  therefore,  this  soldier  is  a  high  risk  for  failure  bn 
the  71L  SQT.  The  high-risk  individual  who  is  motivated  and 
interested  in  a  71L  career  might  try  hard  and  be  fully  successful 
on  the  SQT;  nevertheless,  in  the  long  run  more  high-risk  soldiers 


will  have  troudle  with  SQTs  than  nonhigh-riek  individuals. 

<9) ,  RECOMMEND  that  further  studies  be  conducted  to 
determine  the  extent  to  which  Clerical  scores  as  presently 
configured  should  continue  to  be  used  as  a  standard  tor  accession 
into  the  riL  MCS.  This  recommendation  is  based  on  the  finding 
that  two  other  Aptitude  Areas — Skilled  Tachnician  and  Field 
Artillery — aid  a  better  job  both  individually  and  collectively  of 
predicting  S3Ts  than  did  Clerical  scores.  Part  of  the  reason  for 
this  finding  Is  that  the  Aptitude  Area  Composite  scores  include 
overlapping  ^SVAB  subtest  scores.  For  example.  both  Field 
Artillery  and  Skilled  Technician  areas  include  two  of  the  three 
subtest  scores  which  are  summed  to  derive  Clerical  results.  This 
fact  largely  explains  the  seemingly  illogical  finding  that  Field 
Artillery  scores  do  a  better  job  of  predicting  71L  SQTs  than 
Clerical  scores.  Nevertheless,  one  would  expect  that  Clerical 
scores  should  be  the  best  predictor  if  it  is  to  be  used  as  a 
standard  for  accession  into  71L.  For  this  reason,  studies  should 
be  conducteo  to  determine  how  the  Clerical  Aptitude  Area  score 
needs  to  be  ^'econf i gured  so  it  1 1  do  a  better  job  of  predicting 

‘.2).  T-T.oact  of  soidier  quality  reguirsments  from  changes  in 
equipment,  cocmne,  training,  and  organisation  during  the  next 
five  years.  No  dramatic  changes  in  doctrine  or  organisation  are 
projected  -or  "’ILs  over  the  next  five  years;  however,  Fort 
Jackson  (where  71L  AIT  is  trained)  has  been  fully  automated  with 
WYSE  P.  'sonal  Computers  for  technical  training  in  their  MOS.  This 
is  a  recent  change  from  the  use  of  basic  typewriters  for  this 
training.  Also,  the  Army-wide  admin,  duties  of  71Ls  are  going  to 
reguire  the  ability  to  use  automated  word  processors  and 
computerised  hardware  and  software  of  various  kinds. 

(3).  The  Adjutant  General  school  concurs  with  the  quality 
accession  mix  derived  from  statistical  arsalysis  and  reported  in 
para  e(l)(d)  above. 
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•jummsry 
<l).  Thf 


rs<5uirsd  recruit  accessian  quality  fiiiK  -for  75B 


-T  T  T- 


cateqorv  I . 


[B,  IS. 6%;  and  IV. 


<2),  Deviaticn  in  a  negative  direction  -From  these  standards 
will  '’esuit  in  numer  ical  ly  -fewer  course  graduates  with  a 
degradation  in  academic  standards?  impacting  directly  on  the 
quality  o-f  Personnel  Service  Support. 


b.  Target  Skill  Level 

(1).  Skill  level  (SL)  3  <£— 6)  was  used,  SL  3  was  selected 
because?  as  the  level  -o-f  .uost  75S  section  chiets?  success  or 
-ailure  o-f  the  "OS  mis=i-on  depends  -on  the  per-f.ormance  a-f  75B  E— 
■is. 


c.  !-'er- -for mane e  measure 


(I).  The  -Jkil 
pro-f iciency  in  -^ne 
assumption  that  th 


i  Oual i t icat ion  Test  <SGT)  was  used  to  evaluate 
MOS,  The  selection  o-f  the  SOT  is  based  on  the 
is  measurement  provides  an  acceptable  estimate 


of  performance  of  critical  MOS  tasks.  Furthermore?  the  S3T  was 
used  because  it  provides  a  reliable?  valid  means  of  estimating 
the  ability  to  perform  critical  tasks  at  SL  3. 


<2) -  Content  Validity 

Content  validity  is  the  extent  to  which  a  test  measures  job 
performance  in  the  MOS.  The  SQT  was  systematically  validated  for 
content  by  the  SQT  Branch,  of  DOTD  using  a  series  of  rigorous 
checks  and  reviews  outlined  in  TRADOC  Regulation  351—2?  Skill 
Qual  itif  icati-on  Test  <SQT>  and  Common  Task  Test  (CTT) 
Development?  Policies?  and  Procedures.  These  procedures  included 
a  review  of  the  SQT  task  list?  peer /psychometric  review  of  each 
task  test?  expert /murder  board  review?  editorial  review? 

untrained  tryout?  soldier  tryout?  setting  task  training 

standards?  assigning  final  administration  time  limit?  setting 
minimum  passing  score?  and  final  review  of  camera  ready 
materials. 


(2.).  Reliability 

An  estimate  of  the  internal  reliability  of  the  test  is 
important  to  determine  the  extent  to  which  the  instrument  is 
consistent  (within  itself)  in  measuring  performance.  The 


»POC  for  statist ical/research  methodology  is  Dr.  Phillip  L. 
Vandivier  <.AV  699-.3821). 


Coe■^ticient:  Alpha  procedure  was  used  to  estimate  the  reliability 
of  the  75B  SGT.  Cae*-ficient  Alpha  provides  an  estimate  of  the 
extent  to  whicn  all  tee's  items  intercorrelate  with  one  another.  A 
coefficient  cf  ,77  was  obtained^  which  indicates  the  75B  SQT  has 
adequate  internal  reliability  for  use  in  this  study. 


Desiqr-  and  Implementation 


Admxn istra-v xcn  and  uata  Collection  ^’rocedures 


wM|Xa  adm i n i  =5 "v trr “d  lAW 

351-2.  Also.  the  Armed  Serv 
(A3VAB)  was  administered  upon 
Routine  procedures. 


procedures  outlined  ,n  TRADOC  Reg 
css  Vocational  Aptitude  Battery 
soldier  entry  into  the  Army  I AW 


Data  was  extracted  from  o^^ficial  test  results  obtained  from 
hlLPERCEN  with  the  help  cf  the  SSC-NCR  Liaison.  Memory 
constraints  or,  a'-zaiiable  hardware  prsdu-dsd  the  use  c-f  all  "753 


-'=55  includeo  -S4 


approx  i  ma'C"  i  v 


the  use  of  the 
Personal  Computer 


(a> .  A  stepwise  multiple  regression  procedure  was  conducted  I 
to  determine  what  combination  of  ASVAB  Aptitude  Areas  CArmed 
Farces  Qualification  "^est  (AFQT) ,  Clerical  (CL)  y  Combat  (CO)*  I 
Electronics  Repair  <EL) »  Field  Artillery  CFA>y  General  j 
Maintenance  (GM) ,  Mechanical  Maintenance  (MM) *  Gperators/Food  1 
(OF),  Survei I lance/Communications  (SC),  and  Skilled  Techniciai  ^ 
(ST)  scores)  does  the  best  job  of  predicting  SQT  scores. 

Multiple  regression  is  the  preferred  procedure  used  in  the 
behavioral  sciences  when  the  object  is  to  determine  which  of 
several  combinations  of  predictors  doss  the  best  job  of 

predicting  a  single  criterioni  and  to  determine  hew  much  weight  3 
each  predictor  has  in  the  prediction  of  the  criterion.  Results 
indicated  the  FA  and  AFQT  results  together  significantly  CR=.32| 
F=1S.75;  p<.Ol)  predicted  SQT.  A  total  of  10  per  cent  of  the 
variance  in  SOT  scores  was  explained  fay  FA  and  A'^QT,  FA  accounted 
for  approximately  7.5  per  cent  of  the  variance  in  SQT  scores 
(F=27.29f  p<.001),  followed  fay  AFQT  (F=9.S2|  p<,01),  which 

accounted  for  an  additional  increase  of  2.5  per  cent  in  the 
variance  of  SQT  scores.  After  these  two  no  other  variable  dr 
variables  contributed  significantly  to  the  prediction  Of  SQT. 
(Technically,  no  other  variable  added  anything  unique  to  the 
prediction  of  SQTs  after  FA  and  AFQT  were  already  in  the 
regression  equation.) 


(2).  Data  analyses  were  conducted  with 
Statistical  Package  For  the  Social  Sciences — 
Plus  package.  Results  are  as  follows* 


Although  statist ical ly  significant,  the  strength  of  the 
predictive  relationship  between  FA  and  AFCT,  on  the  one  hand, 
and  SQT  scares,  on  the  other,  can  best  be  described  as  mildi 
Although  lO  per  cent  of  the  variance  in  SQT  scares  was  explained, 
a  total  of  90  per  cent  of  SQT  variance  remains  unexplained  by 


III 


Pl=a==  notss  s'^earson  r  correlat  ions  between  all  ether 
predietDi'H  anc  SGTs  were  eignif leant  {p<.01).  These  correlations 
ranged  t-'c.n  .17  ror  OF  (p^.Oi)  to  .25  -^or  CL  <p<.001).  The  large 
sa-inpie  5ZCS  undoubtedly  contributed  to  the  finding  of  numerous 
positive  correlations  between  SQT  and  various  Aptitude  Areas. 
Never -cheiess •  none  cf  these  variables  significantly  added  to  the 
prediction  ct  C3T  scores  above  and  beyond  what  was  provided  by  FA 
and  aFGT . 


(b/.  A  t  test  was  computed  to  determine  whether  significant 
differences  siJist  oetween  the  SQT  averages  of  soldiers  in  mental 
category  I-IIIA  (upper  50th  percent)  vs-  IIIB-iV  (10  to  49th 
percent)  on  Armed  Forces  Ouai i f ication  Test  results — which  are 
calcuiatsc  >rom  ASVAB  subtest  rfjsults.  The  difference  between  the 
average  ~f  7.H.23  for  caTegoi'y  i-IIIA  soldiers  and  the  mean  of 
71,24  -or  cateaor'.'  IIIaB— IV  personnel  is  stat  ist  icallv 

=  i  gn  I  f  icaro  •:=”•- ^<.001).  Nevertheless*  in  practical  terms 
"-e  oiffe'^encs  zf  c.04  points  c-stweBr-  the  two  1=  less  than 
ovsrwneiiT: •  ng .  A  followup  Feai'son  r  analysis  indicated  a  mild  but 
Significant:  positive  correlation  between  AFQT  and  GOTs  <r=.27; 

P<.001).  ”hes5  analyses  provide  svidenoe  that  SQT  results  ^  tend 
to  increase  with  mental  category. 

(c).  A  minimum  passing  SQT  score  of  60  was  determined  by 
ubject  navter  experts  at  the  school.  Approximately  15%  of  the 
3B  sample  failed  to  meet  this  performance  standard. 

Next*  a  frequency  di-str tbuticn  was  made  of  the  percentages 
of  75Bs  who  passed  and  failed  (using  the  minimum  passing  SQT 
score)  across  different  mental  categories.  Results  were  as 
followsJ 


o 

G 


PERCENTASEI  !jF  PASS/ FAILS  BY  flENTAL  CATE50RY 

riEIMTAL  CATEGORY 


T  I 
X  i_ 

<59  snd 

□  si QW  f 


-T  T 


1  t  O* 


:iB 


IV 


n=9 


O 

R 

fr 


PASS 
<60  and 
a.bovs) 


88.  1% 

n=233 


Si, 


iV. 


ri=145 


75.  0% 
n=27 


Results  indicate 
19%  -for  1 1  IBs  and 
■for  :-IIIAs  X2 


:he  failure  rate  jumps  ‘►■am  12%  -for  I— IIIAe  to 
;5%  +or  IV=.  Corversely?  the  pass  rate  of  88% 
rater  than  that  ^cr  either  'I IBs.  at  31%j  or 
:-thsr  wordST  cata  regaroinp  passes  and  failures 
at  SL  3  dcnsistently  =-srfor:Ti  better  at  higher 


uientai  cat^g»wr  XcrS  • 

<d).  A  siiTiPle  'frequency  distribution  was  run  to  determine  the 
breakdown  soldiers  by  AFQT  mental  categories  in  our  sample. 
Results  inoicated  the  -T-oi lowing* 


SAMPLE  PERCENTAGES  BY 
AFQT  MENTAL  CATEGORY 


I-IIIA 

5C  £**/ 

W  m  w/« 

0=270 


XIIB 
o6.  8/i 
n=178 


IV 

7.4% 

n=36 


These  percentages  provide  an  approKimate  estimate  of  the  present 
■mental  category  breakdown  tor  75Bs  at  SL  3. 

<e)  In  order  to  determine  future  75B  accession  requirements, 
the  following  steps  were  taken  CNOTE*  These  steps  are  outlined  in 
Appendix  G  of  the  Distribution  of  Quality  Program  Handbookls 

(1),  A  frequency  distribution  was  made  of  Clerical 
scores.  Clerical  results  were  used  because  a  minimum  Clerical 
score  is  required  for  entry  into  the  MOS. 

(2).  The  frequency  distribution  of  Clerical  scores  was 
converted  to  an  approKimate  mental  category  distribution  using 
tables  and  procedures  outlined  in  the  Distribution  of  Quality 
Program  Handbook.  ENOTE*  The  frequencies  of  soldiers  which  fell 
within  each  S-point  Clerical  score  category  were  multiplied  by 
separate  factors  for  each  mental  category  which  converted 
Clerical  results  into  an  estimated  frequency  distribution  of 
soldiers  by  mental  category.  Please  refer  to  AppendiK  G  of  the 
Distribution  of  Quality  Program  Handbook  for  further 
clarif ication  and  eHampies  of  this  procedure. 3 


^3)  .  ='src“nt5ge=  -for  sach  mental  category  were 
determined  ‘oy  dividing  irhe  frequencies  of  sums  for  each  category 
by  the  overall  total  ?or  all  categories.  ‘'Percentages  were  77.2 
“^or  category  21.2  for  HIE;  and  1.6  for  IV.) 

(4)  .  Each  men-cal  category  percentage  was  divided  by  a 
■?^actor  which  conf'ols  for  historical  continuation/survival  rates; 


I -II I A:  77/. 1050  =  727.7? 

HIE  ■  21/.  15^3  ==  136.  10 
IV  :  2/. 1709  =  11. 13 

Total  =  '  S75.07 

^  ^5)  .  f^inal  future  accession  rates  were  determined  by 

dividing  each  chese  “^-esults  by  the  total; 

I-IIIA:  727.79/875.07  =  83.27. 

!  1 1 E :  136.1 0 / 875 .07  =  15. 6% 

I V ;  1 1 .  1 G  / 875 . 07  =  1 . 27. 

=  .  Conclusions  and  ' scommen da t ions 

(1).  In  conclusion,  this  study  found  that! 

(a) .  Pield  Artillery  and  Armed  Forces  Qualification  Test 
results  did  the  best  job,  in  that  order,  of  predicting  soldier 
performance  on  the  75B  SL  3  SQT. 

(b)  .  Overall  results  suggest  75Bs  in  higher  mental 
categories  tend  to  score  higher  on  the  SQT  than  those  in  lower 
mental  categories. 

(c) .  Appro:; imately  55.8  per  cent  of  75Bs  presently  are  in 
mental  categories  I-IIIA?  36.8  per  cent  are  from  1 1  IB;  and  7.4 
per  cent  are  from  IV. 

(d)  .  According  td  statistical  analysis  results,  S3, 2  per 
cent  of  future  75Bs  should  come  from  mental  category  I-IIIA;  15.6 
per  cent  should  come  from  1 1  IB;  and  1.2  per  cent  should  come  from 
IV. 

<e) .  RECOMMEND  the  use  of  the  following  multiple 
regression  equation  which  uses  Field  Artillery  and  Armed  Forces 
Qualification  Test  results  to  predict  success  of  future  75B 
recruits  on  the  SQT; 


(.1585)  >;  (FA)  +  (.1254)  ::  (AFQT)  +  52.95  =  Predicted  SQT  Score 


EXAMPLE; 

(.1585)  :<  (35)  +  (.1254)  >:  (80)  +  52.95  =  76.46 

Any  score  which  falls  within  13  points  of  the  SQT  cutoff  (60) 
indicates  a  high-risk  individual.  For  e:<ample5  a  recruit  who 
scores  35  on  FA  and  80  on  the  AFQT  obtains  a  predicted  SQT  score 
of  76.46 — which  is  not  within  13  points  of  the  cutoff  (60); 
therefore,  this  soldier  is  not  high  risk  for  failure  on  the  75B 
SQT.  Please  note;  High-risk  individuals  who  are  motivatec.'  and 
interested  in  a  75B  career  might  try  hard  and  be  fully 
successful  on  the  SQT;  nevertheless,  in  the  long  run  more  high- 


risK  sol di ar=  will  '-.ave  trouDls  ■'Jiirh  -rQTs  than  nonhigh-risk 
individuals. 

'9) .  RECOMMEND  that  further  studies  be 
detarmine  :he  extent  to  which  Clerical  scares 
contigurea  should  continue  bo  be  used  as  a  standard 


conducted  bo 
as  presently 
•:Ror  accession 


into  the  ■’'SB  MQS.  This  recommendat ion  is  based  on  t'ne  seemingly 
illogical  finding  that  Field  Ai'tiliery  did  a  better  job  of 
predicting  75E-!  EQTs  than  did  Clerical  scores.  Part  of  the  reason 
for  this  finding  is  that  bhe  Aptitude  Area  Composite  score  .or 
Field  Artillery  includes  two  of  the  three  subtest  scores  which 
are  summed  to  derive  Clerical  results.  Neverthelessi  one  would 
expect  that  Clerical  scores  should  be  the  best  predictor  if  it  is 
to  ce  used  as  a.  standaro  for  Accession  into  75B.  For  this  reason? 
studies  should  ~e  conducted  to  determine  whether  and  how  the 
^le»'ical  Aptitude  Area  score  needs  to  be  reconfigured  so  it  will 
do  a  better  -ob  of  predicting  success  on  the  75B  SQT. 

f2) .  Changes  in  doctrine,  braining?  technical  aoility?  etc. 
which  a.i-e  expected  to  i.upact  cn.  tne  duality  of  soldiers  needed 
fi/e  /ears  r-z\‘)  i-ciuce  t'ne  .ccrpletion  of  TACCC?  whicn  will 
'enuirs  coTiP.v.ter-  •.-.v-r-cy  o-f  a.  j  i  “oBs.  ''•estructur  mg  o'-  personnel 
organ  1  cat i cns  may  enuire  an  increase  m  flexibility  ana 
per'-.aps  task  .-eai  ignmenc. 


(3).  Because  of  the  above  drivers?  tne  quality  accession  75B 
mix  should  be  33. 2‘/.  for  'I -1 1 1  A?  15.67.  for  1 1  IB!  and  1.27. 
for  IV.  Any  reduction  from  this  standard  will  seriously  degrade 
the  75E’s  ability  to  support  the  soldier  and  Commander  on  the 
battlefield. 
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a.  Summary 

(1) .  The  required  recruit  accession  quality  mix  for  MOS  75C 
should  be  84.8%  for  mental  categories  I-IIIA;  14.0%  for  IIIB;  and 
1.2%  for  IV. 

(2) .  Deviatic  in  a  negative  direction  from  these  standards 
will  result  in  numerically  fewer  course  graduates  concurrent  with 
a  degradation  in  academic  standards^  impacting  directly  on  the 
quality  of  Personnel  Service  Support. 

b.  Target  Skill  Level 

(1).  Skill  level  ( SL)  3  (E-6}  was  used.  SL  3  was  selected 
because  this  is  the  level  of  most  section  chiefs  in  this  MOS 
throughout  the  Army.  For  this  reason..  performance  of  SL  3 
soldiers  is  critical  for  mission  success. 

c.  Performance  measure 

(1).  The  Skill  Qualification  Test  ( SQT )  was  used  to  evaluate 
proficiency  in  the  MOS.  The  selection  of  the  SQT  is  based  on  the 
assumption  that  this  measurement  provides  an  acceptable  estimate 
of  performance  of  critical  MOS  tasks.  Furthermore,  the  SQT  was 
used  because  it  provides  a  reliable,  valid  means  of  estimating 
the  ability  to  perform  critical  tasks  at  SL  3. 

(2).  Content  Validity 

Content  validity  is  the  extent  to  which  a  test  measures  job 
performance  in  the  MOS.  The  SQT  was  systematically  validated  for 
content  by  the  SQT  Branch  of  DOTD  using  a  series  of  rigorous 
checks  and  reviews  outlined  in  TRADOC  Regulation  351-2,  Skill 
Qualitif ication  Test  (SQT)  and  Common  Task  Test  (CTT) 
Development,  Policies,  and  Procedures.  These  procedures  included 
a  review  of  the  SQT  task  list,  peer/psychometric  review  of  each 
task  test,  expert/murder  board  review,  editorial  review, 
untrained  try'.'.t,  soldier  tryout,  setting  task  training 
standards,  assi'-iing  final  administration  time  limit,  setting 
minimum  passing  score,  and  final  review  of  camera  ready 
materials . 

( 2. ) 0  Re) lability 

An  estimate  of  the  internal  reliability  of  the  test  is 
important  to  determine  the  extent  to  which  the  instrument  is 
consistent  (within  itself)  in  measuring  performance.  The 
Coefficient  Alpha  procedure  was  used  to  estimate  the  reliability 
of  the  75C  SQT.  Coefficient  Alpha  provides  an  estimate  of  the 


*This  report  format  follows  the  DO  Anlaysis  Report  format  on 
page  12  of  the  Distribution  of  Quality  Program  Handbook,  dated 
Jun  87,  and  published  by  SSC-NCR.  POC  for  the  emperical  portions 
of  this  report  is  Dr.  Phillip  Vandivier,  AV  699-3821. 
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extent  to  which  all  teat  items  intercorrelate  with  one  another.  A 
coefficient  of  .7354  was  obtained,  which  indicates  the  SL  3  75C 
SQT  has  a  moderate,  or  acceptable  amount  of  internal  reliability. 


d.  Research  Design  and  Implementation 

fl).  Test  Administration  and  Data  Collection  Procedures 

SOTs  were  administered  lAW  procedures  outlined  in  TRADOC  Reg 
351-2.  Also,  the  Armed  Services  Vocational  Aptitude  Battery 
(ASVA6)  was  administered  upon  soldier  entry  into  the  Army  lAW 
routine  procedures. 

Data  was  extracted  from  official  test  results  obtained  from 
HILPERCEN  with  the  help  of  the  SSC-NCR  Liaison.  The  entire 
population  of  392  SL  3  75Cs  was  used;  however,  computation 
requirements  necessitated  the  elimination  of  some  records  because 
of  incomplete  data. 

(2).  Data  analyses  were  conducted  with  the  use  of  the 
Statistical  Package  For  the  Social  Sciences--Persor,al  Computer 
Plus  package.  Results  are  as  follows; 

(a).  A  stepwise  multiple  regression  procedure  was  conducted 
to  determine  what  combination  of  ASVAB  predictor  variables  [Armed 
Forces  Oualif ication  Test  (AFQT),  Clerical  (CL),  Army  Combat 
(CO),  Electronics  (EL).  Fieid  Artillery  (FA),  General  Maintenance 
(GM),  Mechanical  Maintenance  fiMM),  Operators/Food  (OF)  , 
Surveil lance/Communicaticns  tSC)  and  Skilled  Technical  (ST) 
scores]  did  the  best  job  of  predicting  SQT  scores.  Multiple 
regression  is  the  preferred  procedure  used  in  the  behavioral 
sciences  when  the  object  is  t  ;  determine  which  of  several 
combinations  of  predictors  the  best  job  of  predicting  a 

single  criterion;  and  to  d'^term  ’  ne  how  much  weight  each  predictor 
has  in  the  prediction  of  the  criterion.  Multiple  regression 
results  indicated  AFOT,  FA,  EL,  AND  GT  together  significantly  (R» 
.429;  F=i2.89;  p<.01)  predicted  SL  3  SQTs.  A  total  of  18.4  per 

cent  of  the  variance  in  75C  SQT  scores  was  explained  by  these 
four  variables  in  combination.  AFQT  results  accounted  for 
approximately  10.3  per  cent  of  the  variance  in  SQT  scores 
(Fss26.60;  p<.001);  followed  by  FA  (F=9,8e5;  p<.01),  which 

accounted  for  an  additional  3.7  per  cent;  followed  by  EL  (F«8.79; 
p<.01),  which  explained  2.8  per  cent  of  the  variability  in  SQT 
scores;  followed  by  GT  (F=4.45;  p<.05},  which  accounted  for  the 

final  1.6  per  cent  of  the  variance  in  SQTs.  Aftar  these  four  no 
other  variable  or  variables  contributed  significantly  to  the 
prediction  of  SQT. 

Although  statistically  significant,  the  strength  of  the 
predictive  relationship  between  AFQT,  FA,  EL,  and  GT,  on  the  one 
hand,  and  SQT  scores,  on  the  other,  can  best  be  described  as 
weak;  Although  18.4  per  cent  of  the  variance  in  SQT  scores  was 
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explained,  a  total  of  81.6  per  cent  of  SQT  variance  remains 
unexplained  by  ilSVAB  scores. 

Please  note:  Mild  but  statistically  significant  Pearson  r 
correlations  with  SQTs  were  found  for  several  other  predictor 
variables,  including  ST  {r=+.30;  p<.001);  SC  (r=+.23;  p<.001);  GM 
(r=+.24;  p<.001);  and  CL  (r=+.23;  p<.001).l).  Nevertheless,  none 
of  these  variables  significantly  added  to  the  prediction  of  SQT 
scores  above  and  beyond  what  was  provided  by  AFQT,  FA,  EL,  and 
GT.  (Technically,  none  of  these  variables  made  significant 
contributions  to  the  prediction  of  SQTs  after  AFQT,  FA,  EL,  and 
GT  scores  were  already  entered  into  the  regression  equation. ) 
AFQT,  FA,  EL,  and  GT  scores  had  Pearson  r  correlations  with  SQTs 
of  +.32  (p<.00l),  +.31  (p<.001),  +.15  (p>.05),  and  +.32  {p<.001), 
respectively.  ilQTs,  respectively. 


(b) .  A  t  test  was  computed  to  determine  whether  significant 
differences  exist  between  the  SQT  averages  of  soldiers  in  mental 
category  I-IIIA  (upper  50th  percent)  vs.  IIIB-IV  (10  to  49th 
percent)  on  Arned  Forces  Qualification  Test  results--which  are 
calculated  from  ASVAB  subtest  results.  The  difference  between  the 
average  of  79.77  for  category  I-IIIA  soldiers  and  the  mean  of 
74.65  for  category  IIIB-IV  personnel  is  statistically  significant 
(t=3.89;  p<.001).  Nevertheless,  the  difference  of  5.12  between 
the  two  in  practical  terms  is  less  than  overwhelming.  A  followup 
Pearson  r  analysis  indicated  a  mild  but  significant  positive 
correlation  between  the  two  variables  (r*.32;  p<.001).  These 
analyses  provide  convincing  evidence  that  SQT  results  ^  tend  to 
increase  with  mental  category. 

(c) .  A  minimum  passing  SQT  score  of  60  was  determined  by 
subject  matter  experts  at  the  school.  Approximately  10%  of  the 
75C  sample  failed  to  meet  this  performance  standard. 

Next,  a  frequency  distribution  was  made  of  the  percentages 
of  75C8  who  passed  and  failed  (using  the  minimum  passing  SQT 
score)  across  different  mental  categories.  Results  were  as 
follows : 

PERCENTAGE  OF  PASS/FAILS  BY  MENTAL  CATEGORY 

MENTAL  CATEGORY 


I-IIIA  IIIB  IV 

S 

Q  FAIL 

T  (59  and  8.7%  7.9%  23.3% 

below)  n=22  n=8  n*7 

S  _ 

C  PASS 

0  (60  and  91.3%  92.1%  76.7% 

R  above)  n=230  n*93  n=23 

E  _ 

S 
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Results  indicate  the  failure  rate  jumped  from  8-9%  for  I-IIIAs 
and  IIIBs  to  23%  for  IVs.  Conversely,  the  pass  rate  dropped  from 
91-92%  for  I-IIIAs  to  77%  for  IVs. 

(d).  A  simple  frequency  distribution  was  run  to  determine  the 
breakdown  of  soldiers  by  AFOT  mental  categories  in  our  sample. 
Results  indicated  the  following: 


SAMPLE  PERCENTAGES  BY 
AFOT  MENTAL  CATEGORY 

I-IIIA  IIIB  IV 

65.8%  26.4%  7.8% 

n=252  n=101  n=30 


These  percentages  provide  an  approximate  estimate  of  the  present 
mental  category  breakdown  for  75Cs. 

(e).  In  order  to  determine  future  75C  accession  requirements, 
the  following  steps  were  taken  [NOTE:  These  steps  are  outlined  ir> 
Appendix  G  of  the  Distribution  of  Quality  Program  Handbook] : 

(1).  A  frequency  distribution  was  made  of  CL  scores.  CL 
results  were  used  because  a  minimum  CL  score  is  required  for 
entry  into  the  MOS. 

(2).  The  frequency  distribution  of  CL  scores  was 
converted  to  an  approximate  mental  category  distribution  ^sing 
tables  and  procedures  outlined  in  the  Distribution  of  Quality 
Program  Handbook.  [NOTE:  The  frequencies  of  soldiers  which  fell 
within  each  5-point  CL  score  category  were  multiplied  by 
separate  factors  for  each  mental  category  which  converted  Cl 
results  into  an  estimated  frequency  distribution  of  soldiers  by 
mental  category.  Please  refer  to  Appendix  G  of  the  Distribution 
of  Quality  Program  Handbook  for  further  clarification  and 
examples  of  this  procedure.] 

(3).  Percentages  for  each  mental  category  were 
determined  by  dividing  the  frequencies  of  sums  for  each  category 
by  the  overall  total  for  all  categories.  (Percentages  were  79.2 
for  category  I-IIIA;  18.8  for  IIIB;  and  2.0  for  IV.) 

(4).  Each  mental  category  percentage  was  divided  by  a 
factor  which  controls  for  historical  continuation/survival  rates: 


I-IIIA:  79/. 1058 
IIIB  :  19/. 1543 
IV  :  2/. 1789 


746.69 

123.14 

11.18 


Total  =  881.01 


(5).  Final  future  accession  rates  were 
dividing  each  of  these  results  by  the  total: 


determined  by 
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I-IIIA:  746.69/881.01  =  84.8% 

IIIB:  123.14/881.01  =  14.0% 

IV:  11.18/881.01  =  1.2% 

e.  Conclusions  and  recoaaendations 

(1).  In  conclusion,  this  study  found  that: 

(a) .  Armed  Forces  Qualification  Test  scores.  Field 
Artillery,  Electronics,  and  General  Technical  scores  do  the  best 
job,  in  that  order,  of  predicting  SL  3  75C  SQTs. 

(b) .  75C8  in  higher  mental  categories  score  somewhat 

higher  on  the  SL  3  SQT  than  those  in  lower  mental  categories. 

(c) .  Approximately  65.8  per  cent  of  75C8  presently  are  in 
mental  categories  I-IIIA;  26.4  per  cent  are  from  IIIB;  and  7.8 
per  cent  are  from  IV. 

(d) .  According  to  statistical  analysis  results,  84.8  per 
cent  of  future  75C8  should  come  from  mental  category  I-IIIA;  14.0 
per  cent  should  come  from  IIIB;  and  1.2  per  cent  should  come  from 
IV. 

(e) .  RECOHMEND  the  use  of  the  following  multiple 
regression  equation  which  uses  AFQT,  FA,  EL,  and  GT  scores  to 
predict  success  of  future  75C  recruits  on  the  SQT: 

(.1165)  X  (AFQT)  +  (.2252)  x  (FA)  +  (-.2035)  x  EL  '  (.1683)  x  GT  * 

48.61  =  Predicted  SQT  Score 

EXAMPLE: 

(.1165)  X  (80)  +  (.2252)  x  (81)  +  (-.2035)  x  79  x  (.1683)  x  75  + 

48.61  -  72.72 

Any  predicted  SQT  score  which  falls  within  11  points  of  the  SQT 
cutoff  (60)  indicates  a  high-risk  individual.  For  example,  a 
recruit  who  scores  80,  81,  79,  and  75  on  the  AFQT,  FA,  EL,  and 

GT,  respectively,  obtains  a  predicted  score  of  72.72 — which  is 
not  within  11  points  of  the  cutoff;  therefore,  this  soldier  is 
not  a  high  risk  for  failure  on  the  SL  3  75C  SQT.  The  high-risk 
individual  who  is  motivated  and  interested  in  a  75C  career  might 
try  hard  and  be  fully  successful  on  the  SL  3  SQT;  nevertheless, 
in  the  long  run  more  high-risk  soldiers  will  have  trouble  with 
SQTs  than  nonhigh-risk  individuals. 

( 9 } .  RECOMMEND  that  further  studies  be  conducted  to 
determine  the  extent  to  which  Clerical  scores  as  presently 
configured  should  continue  to  be  used  as  a  standard  for  accession 
into  the  75C  MOS.  This  recommendation  is  based  on  the  finding 
that  other  Aptitude  Areas — including  FA,  AFQT,  and  GT — did  a 
better  job  of  predicting  SL  3  SQTs  than  did  Clerical  scores.  Part 
of  the  reason  for  this  finding  is  that  the  Aptitude  Area 
Composite  scores  include  overlapping  ASVAB  subtest  scores.  For 
example,  both  FA  and  AFQT  include  two  of  the  three  subtest 
scores  which  are  summed  to  derive  Clerical  results.  This  fact 
largely  explains  the  seemingly  illogical  finding  that  Field 
Artillery  scores  do  a  better  job  of  predicting  75C  SQTs  than 
Clerical  scores.  Nevertheless,  one  would  expect  that  Clerical 


scores  should  be  the  best  predictor  i£  it  is  to  be  used  &s  a 
standard  for  accession  into  75C.  For  this  reason,  studies  should 
be  conducted  to  determine  how  the  Clerical  Aptitude  Area  score 
needs  to  be  reconfigured  so  it  will  do  a  better  job  of  predicting 
success  on  the  75C  SQT. 

(2) .  Changes  in  equipment,  doctrine,  training  and 
organization  during  the  next  five  years  which  will  impact  on 
soldier  quality  requirements  for  75C  include  the  completion  of 
fielding  of  TACCS,  which  will  require  computer  literacy  of  all 
75Cs.  Restructuring  of  personnel  organizations  may  require  an 
increase  in  flexibility  and  perhaps  task  realignment. 

(3) .  Because  of  the  above  drivers,  the  quality  accession  SL3 
75C  should  be  84.8%  for  mental  categories  I-IIIA;  14%  for  IIIB; 
and  1.2%  for  17.  Any  reduction  from  this  standard  will  seriously 
degrade  the  Adjutant  General  School's  ability  to  provide  soldiers 
capable  of  providing  needed  support  to  the  troops  and  commander 
on  the  field. 
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DISTRIBUTI0^4  OF  QUALITY  <DQ)  REPORT 
FOR  75C* 

■zi • 

(1) .  The  f'equired  recruit  accession  quality  mix  for  MOS  75C 
should  be  04.0";  for  mental  categories  I-IIIA;  14,0%  for  IIIBj  and 
1.2%  for  :v. 

(2)  .  Deviation  in  a  negative  direction  from  these  standards 
will  result  numerically  fewer  course  graduates  concurrent  with 
a  degradation  in  academic  standardsi  impacting  directly  on  the 
quality  of  Personnel  Service  Support. 

b.  Target  Skill  Level 


<1) 


i  'i  t 

^  r<.  1  ^  ^ 


level  »3L)  3  (E-6)  was  used.  SL  3  was  selected 


because  this  is  the  level  of  most  section  chiefs  in  this  MOS 
thi’oughout  -he  Army.  For  this  reason^  performance  of  SL  3 
soldiers  is  ci'iticai  for  mission  success. 

c.  Per f or “ance  measure 

■'1).  “he  Si-ill  Qualification  "^est  (GOT)  was  used  to  evaluate 
proficiency  in  the  MOS.  The  eelection  of  the  3QT  is  based  on  the 
assumption  that  this  measurement  provides  an  acceptable  estimate 
of  performance  of  critical  MOS  tasks.  Furthermore?  the  SQT  was 
used  because  it  provides  a  reliable?  valid  means  of  estimating 
the  anility  to  perform  critical  tasks  at  SL  3. 


(2).  Content  Validity 

Content  validity  is  the  extent  to  which  a  test  measures  job 
performance  in  the  MOS.  The  SQT  was  systematically  validated  for 
content  by  the  SQT  Branch  of  DOTD  using  a  series  of  rigorous 
checks  and  reviews  outlined  in  TRADQC  Regulation  351-2?  Skill 
Quaiitif  icaticTi  Test  <3QT)  and  Common  Task  Test  (CTT) 
Development.  Po’icies?  and  Procedures.  These  procedures  included 
a  review  of  the  SQT  task  list?  peer/psychometric  review 
task  test?  expert/murder  board  review?  editorial 
untrained  tryout?  soldier  tryout?  setting  task 
standards?  assigning  final  administration  time  limit? 
minimum  passing  score? 
materials. 


of  each 
review? 
training 
setting 

and  final  review  of  camera  ready 


(2.).  F;eliability 

An  estimate  of  the  internal  reliability  of  the  test  is 
important  to  determine  the  extent  to  which  the  instrument  is 
consistent  (within  itself)  in  measuring  performance.  The 
Coefficient  Alpha  procedure  was  used  to  estimate  the  reliability 
of  the  75C  SQT.  Coefficient  Alpha  provides  an  estimate  of  the 


♦This  report  format  follows  the  DQ  An lays is  Report  format  on 
page  12  of  the  Distribution  of  Quality  Program  Handbook?  dated 
Jun  37?  and  published  by  SSC-NCR.  POC  for  the  emperical  portions 
of  this  report  is  Dr.  Phillip  Vandivier?  AV  699-3821. 


eK'csnt  -^o  which  ail  tssx  items  intercorreiate  with  one  another.  A 
coe-f-icient  ct  .7354  was  c-otaineo,  which  indicates  the  SL  3  75C 
SQT  .-.5,=  a  moaeratsj  or  acceptable  amount  o-f  internal  reliability. 

d.  Research  Design  and  Imp iementation 

'.I).  Test  Admin  istf*  at  ion  and  Data  Collection  Proceoures 

30Ts  were  administered  lAW  procedures  outlined  in  TRADOC  Reg 
351--2.  A1=qi  the  Armed  Services  Vocational  Aptitude  Battery 
(ASVAB)  was  aaministered  upon  soldier  entry  into  the  Army  'lAW 
i^.Dutine  procedures. 

Data  was  extracted  ^rom  ot+icial  test  results  obtained  from 
rdlLPSRCEN  with  the  help  ot  the  33C-NCR  Liaison.  The  entire 
population  392  2L  3  "^oCs  was  used?  ^-owever ;  computation 
*' SQu i r emen V s  necessitated  the  elimination  or  lome  ^^'icoros  because 
ot  .ncoiTip  late  cata. 

(2).  Data  analysee  were  conducted  with  the  use  of  the 
Statistical  Package  For  the  Social  Sciences — Psrsonal  Computer 
*=’lus  package.  Results  are  as  follows: 

(a).  A  stepwise  multiple  regression  procedure  was  conducted 
to  determine  what  combination  of  ASVAB  predictor  variables  CArmed 
Forces  Qualification  Test  (AFQT) ,  Clerical  (CL) 1  Army  Combat 
(CO).  Electronics  (EL),  Field  Artillery  (FA) .  General  Maintenance 
(GM) ,  Mechanical  Maintenance  (MM),  Operators/Food  (OF)  , 
Survei 1 lance/Communications  (SC),  and  Skilled  Technical  (ST) 
scores!  did  the  best  job  of  predicting  SOT  scores.  Multiple 
regression  is  the  preferred  procedure  used  in  the  behavioral 
sciences  when  the  object  is  to  determine  whicii  of  several 
combinations  ~f  predictors  does  the  best  job  o-  predicting  a 
single  criterion:  and  to  determine  how  much  weight  each  predictor 
has  in  the  pf'ediction  of  the  criterion.  Multiple  regression 
results  indicated  AFQT,  FA,  EL,  AND  6T  together  significantly  (R= 
cent  of  the  variance  in  75C  SQT  scores  was  explained  by  these 
four  variables  in  combination.  AFQT  results  accounted  for 
approximately  10.3  per  cent  of  the  variance  in  SQT  scares 
(F=26.60;  p<.001);  followed  by  FA  (F=9.S65|  p<.01),  which 
accounted  for  an  additional  3.7  per  cent?  followed  fay  EL  (F=8.79; 
P<.01),  which  explained  2,8  per  cent  of  the  variability  in  SQT 
scores?  followed  by  GT  (F=4,45?  p<.05),  which  accounted  for  the 
final  1.6  per  cent  of  the  variance  in  SQTs.  Aftesr  these  four  no 
other  variable  or  variables  contributed  -.igniv icantly  to  the 
prediction  of  SQT. 

Although  statistically  significant,  Ihe  strength  of  the 
predictive  relationship  between  AFQT,  FA,  E_,  and  GT,  on  the  one 
hand,  and  SQT  scores,  on  the  other,  can  sest  be  described  as 
weak:  Although  13.4  per  cent  of  the  variance  in  SQT  scores  was 
explained,  a  total  of  SI. 6  per  cent  of  TQT  variance  remains 


in  N 


unexplained  by  ASVAB  ecores. 

Please  noxe:  Mild  but  statistira.i  ly  significant  Pearsan 
correlations  with  SQTs  were  Found  -for  several  other  predictor 
variablesi  including  ST  (r=+.30;  p<.00i;?  SC  (r=+.23|  p<.001);  GM 
^r  =  f,24:  and  CL  (r=f.23;  p<.001).l).  Nevertheless,  none 

of  tnese  -.ariabies  significantly  addeo  to  the  prediction  of  3QT 
scores  above  and  beyona  what  was  provided  by  AFQT,  PA,  EL,  and 
GT.  ‘Techn icai ly :  none  of  these  variables  made  significant 
contr Ibut ions  to  the  prediction  of  SQTs  after  AFQT,  FA,  EL,  and 


8T  scores 

were  air'escy  en termed 

in-co  the 

regression 

equation. ) 

AFQT ,  FA , 

^nd  v?T  ecores 

F’earson  r 

correlations 

With  SQTs 

of  +• .  32  ( »  =: 

-  00 1 )  ^,31  .  00 1 )  ^ 

-?•  -  1 5  ( p  > . 

05),  and  +.32 

(pf.OOl) , 

f ■e5t.'e?(_  1  vex 

y  •  ‘.V  u#  ■  s  ?  r  s  s  p  e  c  V 1  e  1  y  • 

fb).  i  0 
differences  sx 
category  III 


test  was  cQiTiDuted  to  determine  wnetner  significant 
ISO  between  tne  SQT  averages  of  soldiers  in  mental 
I.—  ’.u.soe*''  bOth  oeroens)  vs.  >10  to  ^Sth 

y'lec  ‘“crces  C-ua  1 1  f  ic  a  1 1  on  “est  results — wnicn  are 


oaicuiateo  -"om  ~I''An  suotost  'esult 
average  7T  -or  catsaory  I  — II 
~4.65  for  category  IIIB-IV  personnel 


.  "he  difference  between  the 
A  soldiers  and  the  ihea.n  of 
15  statistically  significant 


't=I>.S9:  pf.OOl',  Nevertheless,  the  difference  of  5.12  between 
the  two  in  practical  terms  is  less  than  overwhelming.  A  followup 
Pearson  •-  analysis  indicated  a  mild  but  significant  positive 
ccrrelatior.  between  the  two  variaoles  i'r=.32;  p<.001>.  These 
analyses  prcvics  convincing  evidence  that  'GQT  results  ^  tend  to 
increase  with  mental  category. 


(c) -  A  minimum  passing  SQT  score  of  60  was  determined  by 
ubject  matter  experts  at  the  school.  Approximately  105i  of  the 
5C  sample  failed  to  meet  this  performance  standard. 


Next,  a  -repuency  distribution  was  made  of  the  percentages 
of  75C5  who  passed  and  failed  (using  the  minimum  passing  SQT 
score)  across  different  mental  categories.  Results  were  as 
f ol lows! 

PERCENTAGE  OF  PASS/FAILS  SY  MENTAL  CATEGORY 

MENTAL  CATEGORY 


I-IIIA  IIIB  IV 

S 

Q  FAIL 

T  (59  and  8.77.  7.97.  23.3% 

below)  n=22  n=S  n=7 

S  _ _ 

C  PASS 

Q  (60  and  91.3%  92.17.  76.7% 

R  above)  n=230  n=93  n=23 

E  _ 

c 


I-IIIA: 
1 1  IE: 
IV: 


S4.S7. 
14.07 
1 . 27. 


746.69/881.01  = 
123.14^881.01  = 

r.  wOnc  1  LIS  1  on 5  kH cJ  p scQ/nnisri X on s 


•1).  In  conclusion,  this  study  -found  that: 

■;a).  Ai'iusd  Forces  Qualification  Test  scores,  Field 
Artillery?  electronics,  and  General  Technical  scores  do  the  best 
jOD-i  in  that  order?  -o-f  predicting  SL  3  75C  SQTs. 

'b>.  758=  in  higher  -Tiental  categories  s-core  somewhat 

higner  on  tne  3L  3  SQT  than  those  in  lower  mental  categories. 

<c;.  Appro’; imateiy  65.8  Per  cent  o-f  75Cs  presently  are  in 


.ones  i 


IA5  2^ 


=er  cent  are  -from  1 1  IB;  and  7.8 


}-'er  i_!snt  ar  e  ■fr*_"isi  iv. 

^ d) .  Accc-i'dinp  to  statistical  anal'/sis  results,  34.8  per 
cent  of  f-j.ture  TSCs  should  come  from  mental  category  I-IIIA;  14.0 
per  cent  sneuid  come  'r'om  illB;  ana  1.2  per  cent  should  come  from 


f*  ^ M  c  h  * 

■•  £15-Ul  :nsi!  -1/ 


use  of-  the  ‘-oi  lowing  multiple 


regressi-cn  =-guaci 


on  which  usee  AFQT,  ”A,  EL,  ano  GT  st.Dres  to 


predict  success  of  future  T’SC  recruits  on  the  S-2T: 


(.1165)  <AFgT?  -s-  (.2252/  x  (FA)  -i-  (-.2035)  x  EL  (.1683)  x  QT  h 

48.61  =  Predicted  SQT  Score 


EXAMPLE: 

^.1165)  X  (SO)  +  (.2252)  x  (81)  +  (-.2035)  x  79  x  (.1683)  x  7S  + 

48.61  =  72.72 

Any  predicted  SOT  score  which  falls  within  11  points  of  the  SQT 
cutoff  (60)  indicates  a  high-risk  individual.  For  example,  a 
recruit  who  scores  30,  81,  79,  and  75  on  the  AFQT,  FA,  EL,  and 

GT,  respectively,  obtains  a  predicted  score  of  72.72 — wl  * 
not:  within  11  points  of  the  cutoff;  therefore,  this  soldier  xs 
not  a  high  risk  fo:-  failure  on  the  SL  3  75C  SQT.  The  high-risk 
individual  who  is  motivated  and  interested  in  a  75C  career  might 
try  hard  and  be  fully  successful  on  the  SL  3  SQT;  nevertheless, 
in  the  long  run  more  high-risk  soldiers  will  have  trouble  with 
SQTs  than  nonhign-risk  individuals. 

(9) .  RECOMMEND  that  further  studies  be  conducted  to 
determine  the  extent  to  which  Clerical  scores  as  presently 
configured  should  continue  to  be  used  as  a  standard  for  accession 
into  the  75C  MOS.  This  recommendation  is  based  on  the  finding 
that  other  Aptitude  Areas — including  FA,  AFQT,  and  GT—did  a 
better  jcb  of  predicting  SL  3  SQTs  than  did  Clerical  scores.  Part 
of  the  reason  for  this  finding  is  that  the  Aptitude  Area 
Composite  scores  include  overlapping  ASVAB  subtest  scores.  For 
example,  both  FA  and  AFQT  include  two  of  the  three  subtest 
scores  which  are  summed  to  derive  Clerical  results.  This  fact 
largely  explains  the  seemingly  illogical  finding  that  Field 
Artillery  scores  do  a  better  job  of  predicting  7SC  SQTs  than 
Clerical  scares.  Nevertheless,  one  would  expect  that  Clerical 
scores  should  be  the  best  predictor  if  it  is  to  be  used  as  a 
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a.  Summary 

(1) .  The  f-equired  recruit  accession  quality  mix  -for  75D  is 
86.37.  for  I-IIIA,  12.47.  for  1 1  IB,  and  1.37.  for  IV. 

(2)  .  Deviation  in  a  negative  direction  from  these  standards 
will  result  in  numerically  fewer  course  graduates  concurrent  with 
a  degradation  in  academic  standards,  impacting  directly  on  the 
quality  of  Personnel  Service  Support. 

Target  Skill  Level 

(1).  Skill  level  (SL)  3  (E-6)  was  used.  3L  3  was  selected 
because,  as  section  chiefs,  performances  of  75Ds  at  this  critical 
level  determines  success  and  failure  of  the  NOS  mission, 
c.  Performance  measure 

(1).  The  Tkill  Qual  i  f  ication  Test  'SOT)  v*jas  tssed  to  evaluate 
proficiency  in  the  NOS.  The  selection  of  the  SOT  is  based  on  the 
assumption  that  this  measurement  provides  an  acceptable  estimate 
of  performance  of  critical  NOS  tasks.  Furthermore,  the  SQT  was 
used  because  it  provides  a  reliable,  valid  means  of  estimating 
the  ability  to  perform  critical  tasks  at  SL  3. 

(2).  Content  Validity 

Content  validity  is  the  extent  to  which  a  test  measures  job 
performance  in  the  liOS.  The  SQT  was  systematically  validated  for 
content  by  the  SQT  Branch  of  DOTD  using  a  series  of  rigorous 
checks  and  reviews  outlined  in  TRADOC  Regulation  351-2,  Skill 
Quantification  Test  (SQT)  and  Common  Task  Test  (CTT) 
Development,  Policies,  and  Procedures.  These  procedures  included 
a  review  of  the  SQT  task  list,  peer/psychometr ic  review  of  each 
task  test,  sxper t/murder  board  review,  editorial  review, 
untrained  tryout,  soldier  tryout,  setting  task  training 
standards,  assigning  final  administration  time  limit.  Setting 
minimum  passing  score,  and  final  review  of  camera  ready 
materials. 

(2. ) .  Rel iabi 1 ity 

An  estimate  of  the  internal  reliability  of  the  test  is 
important  to  determine  the  extent  to  which  the  instrument  is 
consistent  (within  itself)  in  measuring  performance.  The 
Coefficient  Alpha  technique  was  used  to  estimate  the  reliability 
of  the  SL  3  75D  SQT. 


POC  for  statistical/research  portions  of  this  report  is  Dr. 
Phillip  Vandivier,  AV  699-3821. 
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Coet-ficient  Alpha  prcvides  an  estifnate  of  the  SKtent  to 
which  all  test  items  intercorrelate  with  one  another.  A 
coefficient  of  .31  was  obtained»  which  indicates  the  7SD  SL  3 
SOT  has  a  niooerate  amount  of  internal  reliability. 

d.  Research  Design  and  Implementation 

(1).  Test  Administration  and  Data  Collection  Pi-’ocedures 

SQTs  were  administered  lAW  procedures  outlined  in  TRADOC  Reg 
351-2.  Also.  t'.'ie  Armed  Services  Vocational  Aptitude  Battery 
fASVAB5  was  administered  upon  soldier  entry  into  the  Army  lAW 
routine  procedures. 

Data  was  extracted  from  official  test  results  cbtained  from 
iilLPERCEN  with  the  help  of  the  SSC-NCR  Liaison.  All  463  available 
cases  (the  entire  population  of  SL  3  75Ds>  were  used  for  data 
analyses. 


(2).  Data  analyses  i-iere  conducted  wii'h  the  .'se  of  the 
Statistical  "’acl-iage  Tor  the  Social  Sciences — ^'ersonal  Computer 
Plus  package.  Results  are  as  follows: 

(a).  A  stepwise  multiple  regression  procedure  was  conducted 
to  cetsrmine  what  combination  of  ASVAB  Aptitude  Areas  CArmed 
Forces  Qualification  Test  (AFQT) ?  Clerical  (CL)  ,  Combat  (CO) » 
Electronics  Repair  (EL) »  Field  Artillery  (FA) »  General 
Maintenance  (GM) ,  Mechanical  Maintenance  (MM) »  Operators/Food 
(OF) j  Surveillance/Communications  (SC) »  and  Skilled  Technical 
(ST)  scores]  did  the  best  job  of  predicting  SQT  scores.  Multiple 
fr  jression  is  the  preferred  procedure  used  in  the  behavioral 
sciences  when  the  object  is  to  determine  which  of  several 
combinations  of  predictors  does  the  best  job  of  predicting  a 
single  criterion,  and  to  determine  how  much  weight  each  predictor 
has  in  the  prediction  of  the  criterion.  Results  indicated  AFQT 
and  FA  in  together  significantly  predicted  SL  3  75D  SQTs  (R=.356? 
F=20.74;  p<.01).  A  total  of  12.7  per  cent  of  the  variance  in  SQT 
scares  was  explained  by  AFQT  and  FA.  AFQT  accounted  for  10. S  per 
cent  of  the  variance  in  SQT  scores  (F-  33.68;  p<.001)?  followed 

by  FA  (F-7.09;  p<.01)»  which  accounted  for  an  additional  increase 
of  2.2  per  cent  in  the  variance  of  SQTs.  After  these  two  no 
other  variable  or  variables  contributed  significantly  to  the 
prediction  of  SQTs.  (Technical ly?  no  other  variable  added 
anything  unique  to  the  prediction  of  SQTs  after  AFQT  and  FA  were 
already  in  the  regression  equation. ) 

Although  statistically  significant?  the  magnitude  or 
strength  of  the  relationship  between  AFQT  and  FA?  on  the  one 
hand,  and  SL  3  75D  SQTs,  on  the  other,  could  best  be  described  as 
mild:  AFQT  and  FA  together  explained  12.7  per  cent  of  the 

variance  in  SQTs — but  S7,3  per  cent  remains  unexplained  by  ASVAB 
results. 

Please  note:  Pearson  r  results  indicated  several  other  variables 
significantly  predict  SL  3  SQTs,  including  CL  (r=+.27;  p<.001), 


ST  (r=-i-,2G;  pi..  GOD?  and  CO  <i'=+,  IS;  pC.ODj  among  others. 
However?  none  ot  these  variables  made  si.gnit  icant?  unique 
contributions  to  SQTs  above  and  beyond  what  was  accounted  for  by 
AFQT  and  FA. 

(b)  .  A  t  test  was  computed  to  determine  whether  si.gnif  leant 
differences  exist  between  the  3QT  averages  of  soldiers  in  mental 
categories  I-IIIA  (upper  50th  percent)  vs.  IIIB-IV  <10  to  49th 
percent)  on  AFGT  i'esults — which  are  calculated  from  ASVAB 
subtest  results.  The  difference  of  4.75  paints  between  the 
average  of  82.^0  for  category  I-IIIA  soldiers  and  the  mean  of 
77.35  for  category  1 1  IB  personnel  is  statistically  significant 
<t=3.76;  p^.OOl).  A  followup  Pearson  r  analysis  indicated  a  mild 
but  significant  positive  correlation  between  the  two  variables 
J.r=+.33;  p^'.OOl).  These  analyses  provide  evidence  that  SQT 
results  tend  to  increase  with  mental  category. 

(c)  .  A  minimum  passing  SQT  score  of  60  was  determined  by 
subject  matter  experts  at  the  scnool.  Approximately  67.  of  the  75D 
sample  ^sileo  to  meet  this  performance  standard. 

Next.  a  frequency  distribution  was  made  of  the  percenta.ges 
of  75Ds  who  passed  and  failed  (using  the  minimum  passing  SOT 
score)  across  different  mental  categories.  Results  were  as 
fol lows: 


PERCENTAGE  OF  PASS/FAILS  BY  MENTAL  CATEGORY 

MENTAL  CATEGORY 


I-IIIA  IIIB  IV 

S 

Q  FAIL 

T  (59  ana  3.27.  9.47.  14.77 

below)  n=9  n=13  n=5 

S  _ 

C  PASS 

0  (60  and  96.87.  90.67.  85.37. 

R  above)  n=263  n=126  n=29 

E  _ 

S 


Results  indicate  that  the  failure  and  pass  rates  increase  and 
decrease?  respectively?  from  I-IIIAs  to  I I IBs  to  IVs. 

<d).  A  simple  frequency  distribution  was  run  to  determine  the 
breakdown  of  soldiers  by  AFQT  mental  categories  in  our  sample. 
Results  indicated  the  followings 


SAMPLE  PERCENTAGES  BY 
AFQT  MENTAL  CATEGORY 

I-IIIA  1 1 IB  IV  I 
is  1.67.  30.97.  7.6%  3 
n=277  n=139  n=34  1 


These  percentages  provide  an  approjiimate  estimate  of  the  present  i 
mental  category  oreakdown  tor  75Ds  at  £L  3.  j 

'.e)  .  In  order  to  determine  -future  75B  accession  requirementSi  j 
the  following  steps  were  taken  CNOTEj  These  steps  are  outlined  in  } 
^pendi!'!  G  of  the  Distribution  of  Quality  Program  Handbook]:  J 

(1;.  A  frequency  distribution  was  made  of  CL  scores.  CL 
results  were  ,ised  because  a  minimum  CL  score  is  required  for 
entry  into  the  MOS. 

(2) .  ■^he  frequency  distribution  of  CL  scores  was 
converted  rc  an  cvPpro;: imate  mental  category  distribution  using 
tables  ana  procedures  cutlined  in  the  Distribution  of  Quality  i 
Program  Handb-ook.  CNOTE:  The  frequencies  of  soldiers  which  fell 
within  each  5-point  CL  score  category  were  multiplied  by  separate 
factors  for  each  mental  category  which  converted  CL  results  into 
an  estimated  frequency  distribution  uf  soldiers  by  mental 
category.  Please  refer  to  Appendix  G  of  the  Distribution  of 
Quality  Program  Handbook  for  further  clarification  and  examples  | 
of  this  proceaure. ] 

(3)  .  Percentages  for  each  mental  category  were  ■ 
determined  by  dividing  the  frequencies  of  sums  for  each  category 
by  the  overall  total  for  all  categories.  (Percentages  ware  81.1 
for  category  I-IIIAJ  17.4  for  IIIB?  and  1.5  for  IV.) 

(4).  Each  mental  category  percentage  was  divided  by  a 
factor  which  controls  for  historical  cont inuation/survi val  rates:  1 


I-IIIA 

IIIB 

IV 


81/. 1058  =  765,60 

17/. 1543  =  110.18 

2/. 1789  =  11.18 


Total  =  886.96 


(5).  Final  future  accession  rates  were  determined  by 
dividing  each  of  these  results  by  the  total: 


I-IIIA: 

IIIB: 

IV: 


765.60/886.96  =  86.37. 

110.18/886.96  =  12.47. 

11.18/886.96  ==  1.37. 


e.  Conclusions  and  recommendations 

<l).  In  conclusionj  this  study  found  that: 

(a).  Armed  Farces  Qualifications  Test  results  and  Field 
Artillery  scores  did  the  best  job,  in  that  order,  of  predicting 
soldier  performance  on  the  7SD  SL  3  SQT.  No  other  variable 


_  iifflta 


contribucsd  to  the  prediction  ot  SQTs  above  and  beyond  what  was 
provided  by  these  two  variables. 

(b).  Overall  results  suggest  750=  in  higher  mental 
categories  tend  to  score  higher  on  the  3L  3  SQT  than  those  in 
lower  mental  categories. 

<c).  Approximately  hi. 6  per  cent  o-f  75Ds  presently  are  in 
mental  categories  I-IIIA;  30.9  per  cent  are  -from  IIIB?  and  7.6 
per  cent  are  rrom  IV. 

fd/.  According  to  statistical  analysis  results?  36.3  per 
cent  ot  future  75Ds  should  come  from  mental  category  I-IIIA;  12.4 
per  cent  should  come  from  1 1  IB;  and  1.3  per  cent  should  come  from 
IV. 

iei .  RECOMMEND  "he  use  of  the  following  multiple 
reg:  ess  ion  equation  which  uses  AFQT  and  FA  results  to  predict 
success  of  future  75D  recruits  on  the  3L  3  SOT; 

(.1731)  x  <AFQT)  H-  (.1102)  x  <FA)  +  60.25  =  Predicted  SQT 

Score 

EXAMPLE; 

■'.173 1.'-  ,•  vSS'i  “•  (.1102)  fSO)  6'j.25  =  33.3 

Any  predicted  S>2T  score  whic.n  falls  within  11  points  of  the  SQT 
cutoff  (60)  indicates  an  individual  with  high  f'isk  for  failure  on 
the  SL  3  75D  SQT.  F-or  example?  a  recruit  who  scores  35  on  the 
AFQT  and  30  'on  FA  obtains  a  predicted  SL  3  SQT  score  of  83.3 — 
which  is  rot  within  11  points  of  the  cutoff  (60);  therefore?  this 
soldier  is  not  high  risk  for  failure  on  the  SL  3  75D  SQT.  Please 
notes  High-risk  individuals  who  are  motivated  and  interested  in  a 
75D  career  might  try  hard  and  be  fully  successful  on  the  SQT; 
nevertheless?  in  the  long  run  mere  high-risk  soldiers  will  have 
trouble  with  SQTs  than  nonhigh-risk  individuals. 

(9) .  RECOMMEND  that  further  studies  be  conducted  to 
determine  the  extent  to  which  CL  scores  as  presently  configured 
should  continue  to  be  used  as  a  standard  for  accession  into  the 
75D  MOS.  This  recommendation  is  based  on  the  finding  that  AFQT 
and  FA  results  both  did  a  better  job  of  predicting  SL  3  75D  SQTs 
than  did  CL.  Part  of  the  reason  for  this  finding — particularly  in 
the  case  of  FA — is  that  Aptitude  Area  Composite  scores  include 
overlapping  ASVAB  subtest  scores.  For  example?  FA  includes  two  o-f 
the  three  subtest  scores  which  are  summed  to  derive  CL  results. 
This  fact  largely  explains  the  seemingly  illogical  finding  that 
FA  does  a  better  job  of  predicting  SL  3  75D  FjQTs  than  CL  scares. 
Nevertheless  one  would  expect  that  CL  scores  should  be  the  b-9St 
predictor  if  it  is  to  be  used  as  a  standard  for  accession  into 
75D,  For  this  reason?  studies  should  be  conducted  to  determine 
whether  and  how  the  CL  Aptitude  Area  score  needs  to  be 
reconfigured  so  it  will  do  a  better  jab  of  f-edicting  success  on 
the  SL  3  7SD  SQT. 

<2) .  Changes  in  equipment?  doctrine?  trainiing?  and 
organisation  'during  the  next  five  years  which  will  impact  of 
soldier  quality  requirements  for  75D  include  the  completion  of 
fielding  of  TACCS?  which  will  require  computer  literacy  of  all 
75Ds.  Restructur ing  -of  personnel  organisations  may  require  an 


111  iMiHitiiiii 


increase 


in  -flexibility  and  perhaps  task  realignment. 


(3/.  Because  o-f  the  above  drivers^  the  quality  accession 
mix  -for  75Ds  cannot  be  less  than  86.3%  -for  I-IIIA?  12-4%  for 
IIIBl  and  1.3%  for  IV.  Any  reduction  from  this  standard  will 
seriously  degrade  the  Adjutant  General  School’s  ability  to 
provide  soldiers  capable  of  providing  needed  support  to  the 
troops  and  Commander  on  the  battlefield. 
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3.  Summary  3 

(1) .  The  required  recruit  accession  quality  mix  -for  MOS  75E  ] 

should  be  S5.5%  -for  mental  categories  I-IIIA;  13.9%  -for  IIlBl  and 

.6%  -for  IV. 

(2) .  Deviation  in  a  negative  direction  trom  these  standards 
will  result  in  numerically  -fewer  course  graduates  concurrent  with 
a  degradation  in  academic  standards?  impacting  directly  on  the 
quality  o-f  Personnel  Service  Support. 

Target  Skill  Level 

<1).  Skill  level  (SL)  3  (E-6)  was  used.  SL  3  was  selected  ; 
because  this  is  the  level  of  most  section  chiefs  in  this  NOS  j 
throughout  the  Army.  For  this  reason?  performance  of  SL  3  j 
soldiers  is  critical  for  mission  success. 

c.  Performance  measure 

<1).  The  Skill  Qualification  Test  fSQT)  was  used  to  evaluate  I 
proficiency  in  the  MOS.  The  selection  of  the  SQT  is  based  on  the 
assumption  that  this  measurement  provides  an  acceptable  estimate  j 
of  performance  of  critical  NOS  tasks.  Furthermore?  the  3QT  was  1 
used  because  it  provides  a  reliable?  valid  means  of  estimating  j 
the  ability  to  perform  critical  tasks  at  SL  3. 

(2).  Content  Validity 

Content  validity  is  the  extent  to  which  a  test  measures  job 
performance  in  the  MOS.  The  SQT  was  systematically  validated  for 
content  by  the  SQT  Branch  of  DOTD  using  a  series  of  rigorous 
checks  and  reviews  outlined  in  TRADOC  Regulation  351-2?  Skill 
Qualitif ication  Test  (SQT)  and  Common  Task  Test  (CTT) 
Development?  Policies?  and  Procedures.  These  procedures  included 
a  review  of  the  SQT  task  list?  peer /psychometric  review  of  each 
task  test?  expert/murder  board  review?  editorial  review? 
untrained  tryout?  soldier  tryout?  setting  task  training 
standards?  assigning  final  administration  time  limit?  setting 
minimum  passing  score?  and  final  review  of  camera  ready 
materials. 

(2.).  Reliability 

An  estimate  of  the  internal  reliability  of  the  test  is 
important  to  determine  the  extent  to  which  the  instrument  is  ; 
consistent  (within  itself)  in  measuring  performance.  The  . 
Coefficient  Alpha  procedure  was  used  to  estimate  the  reliability 
of  the  7SE  SQT,  Coefficient  Alpha  provides  an  estimate  of  the  ^ 


♦This  report  format  follows  the  DQ  Anlaysis  Report  format  on 
page  12  of  the  Distribution  of  Quality  Program  Handbook?  dated 
Jun  37?  and  published  by  SSC-NCR.  POC  for  the  emperical  portions 
of  this  report  is  Dr.  Phillip  Vandivier?  Analysis  Division? 


Directorate  ot  Combat  Developments^  AV  699-3885, 

extent  to  wni ch  all  test  items  intercorrelate  with  one  another,  A 
coet-Picient  ct  .766  was  obtained,  which  indicates  the  SL  3  75E 
SQT  has  a  moderate,  or  acceptable  amount  oi  internal  reliability. 


d.  Research  Design  and  Implementation 

(1).  Test  Administration  and  Data  Collection  Procedures 

SQTs  were  administered  lAM  procedures  outlined  in  TRADOC  Reg 
351-2.  Also,  the  Armed  Services  Vocational  Aptitude  Battery 
(ASVAB)  was  administered  upon  soldier  entry  into  the  Army  lAW 
routine  procedures. 

Data  was  extracted  ^rom  of-ficial  test  results  obtained  -from 
MILPERCEN  with  the  help  o-f  the  3SC-NCR  Liaison.  The  entire 
population  ot  191  3L  3  75Es  was  used!  however,  computation 
requirements  necessitated  the  eiiminawion  o-f  some  records  because 
o-f  incomplere  data, 

t2) .  Data  analyses  were  conducted  -with  the  use  of  the 
Statistical  PacKage  For  the  Social  Sciences — Personal  Computer 
Plus  packa-ga.  Results  are  as  follows! 

(a).  A  stepwise  multiple  regression  procedure  was  conducted 
to  determine  what  combination  o-f  ASVAB  predictor  variables  CArmed 
Forces  Quali-f  ication  Test  (AFQT) »  Clerical  <CL> ,  Army  Combat 
(CO),  Electronics  (EL),  Field  Artillery  (FA),  General  Maintenance 
(GM),  Mechanical  Maintenance  <MM) ,  Operators/Food  (OF)  , 
Surveillance/Communications  (SC),  and  Skilled  Technical  (ST) 
scores!  did  the  best  job  o-f  predicting  SQT  scares*  Multiple 
regression  is  the  prs-ferred  procedure  used  in  the  behavioral 
sciences  when  the  object  is  to  determine  which  of  several 
combinations  of  predictors  -does  the  best  job  of  predicting  a 
single  critarioni  and  to  determine  how  much  weight  each  predictor 
has  in  the  prediction  of  the  criterion. 

Multiple  regression  results  indicated  FA  and  AFQT  together 
significantly  (R=.5044?  F=20.47;  p<.01)  predicted  SL  3  SQTs.  A 
total  of  25.4  per  cent  of  the  variance  in  75E  SQT  scares  was 
explained  by  these  two  variables  in  combination.  FA  results 
accounted  for  approximately  20.1  per  cent  of  the  variance  in  SQT 
scores  (F=30.39l;  p<.001)J  followed  by  AFQT  CF=8.637|  p<.01), 
which  accounted  for  an  additional  5.4  per  cent  of  SL  3  SQT 
variance.  After  FA  and  AFQT  no  other  variable  or  variables 
contributed  significantly  to  the  prediction  of  SQT. 

Although  statistically  significant,  the  strength  of  the 
predictive  relationship  between  AFQT,  FA,  EL,  and  GT,  on  the  one 
hand,  and  SQT  scores*  on  the  other,  can  best  be  described  as 
weak!  Although  25.4  per  cent  of  the  variance  in  SQT  scores  was 
explained,  a  total  of  74.6  per  cent  of  SQT  variance  remains 
unexplained  by  ASVAB  scores. 


.illllilllliiiiiliiiliiiiiuiilliiiiiiiiii 


Pleass  note;  Mild  but  statistical ly  significant  Pearson  r 
correlations  with  SQTs  ranging  between  +.31  and  +.43  were  found 
for  ALL  other  predictor  variables.  (All  were  significant  at  the 
p<..001  level.)  Nevertheless?  none  of  these  variables 
significantly  added  to  the  prediction  of  SL  3  75E  SQT  scores 
above  and  beyond  what  was  provided  by  FA  and  AFQT.  (Technically? 
none  of  these  variables  made  significant  contributions  to  the 
prediction  of  SOTs  after  FA  and  AFQT  scores  were  already  entered 
into  the  i'egression  equation.  )  FA  and  AFQT  had  Pearson  r 
correlations  with  SQTs  of  +.45  (p<.001)  and  +.43  (p<.001)? 
respectively .  SQTs?  respect i vely.  CL  had  a  Pearson  r  of  +.36  with 
SL  3  SQTs. 


<b).  A  t  ts-z  was  computed  to  determine  whether  significant 
differences  exist  between  the  SL  3  SQT  averages  of  soldiers  in 
mental  category  I-IIIA  (upper  50th  percent)  vs.  IIIB-IV  (10  to 
49th  percent)  on  Armed  Forces  Qualification  "^est  results — which 
are  calculated  "'•'om  ASVAB  suotest  results.  The  differencs  of  8.54 
“nints  between  tte  avsrsQe  of  81.  IC  for  cate*~crv  I  — IIIA  soldiers 
and  the  nean  of  T2,5S  ‘or  category  1113-lv'  personnel  is 
statistical ly  significant  (t=-3-,46?  p<.001).  As  indicated  above? 
a  Pearson  r  analysis  indicated  a  mild  but  significant  positive 
correlation  between  AFQTs  and  SL  3  75E  SQTs  r=+.43?  P<.001). 
These  analyses  provide  convincing  evidence  that  SQT  results  ^ 
tend  to  increase  with  mental  category. 

(c).  A  minimum  passing  SQT  score  of  60  was  determined  by 
subject  matter  experts  at  the  school.  Approximately  7it  of  the  75E 
sample  failed  to  meet  this  performance  standard. 

Next?  a  frequency  distribution  was  made  of  the  percentages 
of  75Es  who  passed  and  failed  (using  the  minimum  passing  SQT 
score)  across  different  mental  categories.  Results  were  as 
follows: 


PERCENTAGE  OF  PASS /FAILS  BY  MENTAL  CATEGORY 

MENTAL  CATEGORY 


I-IIIA  IIIB  IV 

S 

Q  FAIL 

T  <59  and  4.17,  9.67.  25.07. 

below)  n=5  n=5  n=3 

S  _ 

C  PASS 

O  <60  and  95.97.  90.4%  75.07. 

R  above)  0*117  n=47  n*9 

E  _ 

S 

Results  indicate  the  failure  rate  Jumped  from  4%  for  I-IIIAs  to 
10%  and  25%  for  I I IBs  and  IVs?  respectively.  Conversely?  the  pass 
rate  dropped  from  96%  for  I-IIIAs  to  90%  for  I I IBs  and  75%  for 


IVs.  ClsarlVi  this  data  provides  evidence  that  SQT  per-farcnancs 
increases  with  mental  categories. 

■'d).  A  simple  t»'equency  distribution  was  "isn  to  determine  the 
breakdown  ot  soldiers  by  AFQT  mental  categories  in  our  sample. 
Results  indicaved  the  -^ollowings 


SAMPLE  PERCENT AGtiS  By 
AFQT  MENTAL  CATEHCRY 

X-IIIA  IIIB  XV 

65.6-/.  28.0*/.  •  6.5% 

n=122  n=52  ’  n=l2 


These  percentages  provide  an  approuimate  estimate  ot  the  present 
mental  category  breakdown  -for  75£s. 

^e) .  In  order  ~o  determine  -future  73E  '-ccessic-n  requirements, 
the  followin-g  steps  -were  taken  Cf-4uTE:  Thes?  steps  are  outlined  in 
Appendix  G  -0+  the  Distribution  of  Quality  Program  Handbookls 

(1).  A  -frequency  distribution  war  made  c-f  CL  scores.  CL 
results  were  used  because  a  minimum  CL  score  is  required  for 
entry  into  the  MOS. 

(2).  The  frequ  ^  distribution  o-f  CL  scores  was 
converted  to  an  approximate  mental  categc'y  distribution  using 
tables  and  procedures  outlined  in  the  Distribution  of  Quality 
Program  Handbook.  CNOTE:  The  frequencies  of  soldiers  which  fell 
within  each  S-point  CL  score  category  were  multiplied  by 
separate  factors  for  each  mental  category  which  converted  CL 
results  into  an  estimated  frequency  distribution  of  soldiers  by 
mental  category.  Please  refer  to  Appendix  G  of  the  Distribution 
of  Quality  Program  Handbook  for  furtfier  clar  if  ication  and 
examples  of  this  procedure. 3 

<3) .  Percentages  for  each  mental  category  were 
determined  by  dividing  the  frequencies  of  sums  -for  each  category 
by  the  overall  total  for  all  categories.  IPercentages  were  79.5 
for  category  I -I I I A?  IS.S  for  IIIBl  and  1.7  for  IV,) 

(4).  Each  mental  category  percentage  was  divided  by  a 
factor  which  controls  for  historical  cont inuation/survival  rates* 


I-IIIA*  80/. 1058  =  756.14 
IIIB  !  19/. 1543  ^  123.14 
IV  s  I/. 1789  =  5.59 


Total  =  884.87 

(5),  Final  future  accession  r-e’itas  were  determined  by 
dividing  each  of  these  results  by  the  total: 


I-IIIAs 


756. 14/8S4.S7 
123. 14/SS4.S7 
5,59/884.87 


=  85.57. 
=  13.97. 
=  .67. 


e.  Conclusions  and  recommendations 


<1).  In  conciusiorn  this  study  -found  that* 

(a).  Field  Artillery  and  Armed  Forces  dual  i-fi  cat  ion  Test 
scores  do  the  best  job»  in  that  order,  of  predicting  SL  3  75E 
SQTs. 


(b).  75Es  in  higher  mental  categories  score  somewhat 
higher  on  the  SL  3  3GJT  than  those  in  lower  mental  categories. 

<c) .  Approximately  65.6  per  cent  of  7SEs  presently  are  in 
aiental  categories  I-IIIAl  2S.0  per  cent  are  from  IIIBl  and  6.5 
per  cent  are  from  IV. 

(d) .  According  to  statistical  analysis  results,  35. 5  per 
cent  of  future  75Es  should  come  from  mental  category  I-IIIA?  13.9 
per  cent  shoulo  c-ome  from  1 1  IB;  and  .6  ner  cent  should  come  from 

T  i  t 
i  V  • 

•S/ .  RECGMMENB  the  use  of  the  following  multiple 
regression  eguation  which  uses  FA  and  AFdT  scores  to  predict 
suc-csss  of  -future  75E  recruits  on  the  SQTs 


(.2162)  (FA)  -f-  (.1586)  x  (AFQT)  47.12  *  Predicted  3QT  Score 

example; 

(.2162)  X  (75)  -r  (.1586)  x  (72)  +  47.12  =  74.75 

Any  predicted  SQT  score  whicn  falls  within  11  points  of  the  SQT 
cutoff  (60)  indicates  a  high-risk  individual.  For  example,  a 
recruit  who  scores  75  on  the  FA  and  72  on  the  AFQT  obtains  a 
predicted  score  of  74.75 — which  is  not  within  11  points  of  the 
cutoff;  therefore,  this  soldier  is  not  a  high  risk  for  failure 
on  the  SL  3  75E  SQT.  The  high-risk  individual  who  is  motivated 
and  interested  in  a  75E  career  might  try  hard  and  be  fully 
successful  on  the  SL  3  75E  SQT|  nevertheless,  in  the  long  run 
more  high-risk  soldiers  will  have  trouble  with  SQTs  than  nonhigh— 
risk  individuals. 

<9) .  RECOMMEND  that  further  studies  be  conducted  to 
determine  the  extent  to  which  Clerical  scores  as  presently 
configured  should  continue  to  be  used  as  a  standard  for  accession 
into  the  75E  MDS,  This  recommendation  is  based  on  the  finding 
that  other  Aptitude  Areas — including  FA  and  AFQT^ — did  a  better 
job  of  predicting  SL  3  75E  SQTs  than  did  Clerical  scores.  Part  of 
the  reason  for  this  finding  is  that  the  Aptitude  Area  Composite 
scores  include  overlapping  ASVAB  subtest  scares.  For  example, 
both  FA  and  AFQT  include  two  of  the  three  subtest  scores  which 
are  summed  tc  derive  Clerical  results.  This  fact  largely  explains 
the  seemingly  illogical  finding  that  Field  Artillery  scores  do  a 
better  job  of  predicting  75E  SQTs  than  Clerical  scares. 
Nevertheless,  one  would  expect  that  Clerical  scores  should  be  the 
best  predictor  if  it  is  to  be  used  as  a  standard  for  accession 
into  75E.  For  this  reason,  studies  should  be  conducted  to 
determine  how  the  Clerical  Aptitude  Area  scc-ra  needs  to  be 


recanfigurea  ao  it  will  do  a  better  job  o-f  predicting  success  on 
the  75E  SQT. 

(2).  Changes  in  equipment^  doctrine^  trainingj  and 
organisatian  daring  the  next  ^ivf-  years  which  will  impact  on 
soldier  quality  requirments  -for  7CE  include  the  completion  of 
tielding  of  tacCS,  which  will  retuire  computer  literacy  of  all 
75Es,  Restructuring  of  personnel  organisations  may  require  an 
increase  in  flexibility  and  perhaps  task  realignment. 

i3) .  Because  of  the  above  driv  e-rs?  the  quality  accession  mix 
for  7SEs  cannot  be  lass  than  SS.SX  for  mental  categories 
13.9%  for  I I IB;  and  .6%  for  IV.  Any  reduction  from  this  standard 
will  seriously  degrade  the  Adjutant  General  School’s  ability  to 
provide  soldiers  capable  of  providing  needed  support  to  the 
troops  and  commander  on  the  battlefield. 


4. 
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a.  Summary 

<1).  The  required  recruit  accession  quality  for  75F  Is 

90.0%  for  mental  catenories  I-IIIA?  10.0/C  for  IIIBi  and  0.0%  for 
IV. 


<2) .  Deviation  in  a  negative  direction  from  these  standards 
will  result  in  numerically  fewer  course  graduates  concurrent  with 
a  degradation  in  academic  standards?  impacting  directly  on  the 
quality  of  Personnel  Service  Support. 

b.  Target  Skill  Level 

<1).  Skill  level  <SL>  3  (E-6)  was  used.  SL  3  was  Selected 
because.  as  the  level  of  most  75F  section  chiefs?  success  or 
failure  of  the  flQS  mission  depends  on  the  performance  of  75F  E— 

•j^S* 

c .  Per  f  or  m  an  c  e  measur  e 

Cl).  The  Skill  Oual if icat ion  Test  (SOT)  was  used  to  evaluate 
proficiency  in  the  tiOS.  The  selection  of  the  SQT  is  based  on  the 
assumption  that  this  measurement  provides  an  acceptable  estimate 
of  performance  of  critical  NOS  tasks.  Furthermore?  the  SQT  was 
used  because  it  provides  a  reliable?  valid  means  of  estimating 
the  ability  to  perform  critical  tasks  at  SL  3. 

(2).  Content  Validity 

Content  validity  is  the  extent  to  which  a  test  measures  job 
performance  in  the  NOS.  The  SQT  was  systematically  validated  for 
content  by  the  SQT  Branch  of  DOTD  using  a  series  of  rigorous 
checks  and  reviews  outlined  in  TRADOC  Regulation  331—2?  Skill 
Qualitif ication  Test  (SQT)  and  Common  Task  Test  <CTT) 

Development?  Policies?  and  Procedures.  These  procedures  included 
a  review  of  the  SQT  task  list?  peer /psychometric  review  of  each 
task  test?  expert/murder  board  review?  editorial  review? 

untrained  tryout?  soldier  tryout?  setting  task  training 

standards?  assigning  final  administration  time  limit?  setting 
minimum  passing  score?  and  final  review  of  camera  ready 
materials. 

<2. ) .  Reliability 

An  estimate  of  the  internal  reliability  of  the  test  is 
important  to  determine  the  extent  to  which  the  instrument  is 
consistent  (within  itself)  in  measuring  performance.  TTie 


*P0C  for  the  statistical/research  portions  of  this  report  is  Or. 
Phillip  Vandivier  <AV  699-3321). 


Coe+-ficient  Alpha  prc.-rsdure  was  used  to  estimate  the  reliability 
o+  the  75F  SOT.  Coe-f-f icient  Alpha  provides  an  estimate  of  the 
extent  to  which  all  test  items  intercorrslate  with  one  another.  A  ■ 
coetf icient  of  .35  was  obtained*  which  indicates  the  75F  SL  3  SQT 
has  a  moderate  amount  o-f  internal  reliability. 


d.  Research  Design  and  Implementation 

<1).  Test  Administration  and  Data  Collection  Proradures 

SQTs  were  administered  I AW  procedures  outlined  in  TRADOC  Reg 
351-2.  Also-.  the  Armed  Services  Vocational  Aptitude  Battery 
(ASVAB)  was  administered  upon  soldier  entry  into  the  Army  lAW 
Routine  procedures. 

Data  was  extracted  from  o-fficial  test  results  obtained  -from 
MILPERCEN  With  the  heip  of  the  3SC-NCR  Liaison.  Data  analyses 
were  conducted  on  the  entire  copulation  of  13S  SL  3  75Fs. 

<2).  Data  analyses  were  o-onducoed  with  the  use  of  the 
□tatisticai  "ackage  For  the  Social  Sciences — Personal  Computer 
Plus  package.  Results  are  as  -follows* 

(a).  A  stepwise  multiple  regression  procedure  was  conducted 
to  determine  what  combination  of  ASVAB  Aptitude  Areas  CArmed 
Forces  Qualification  Test  (AFOT)  *  Clerical  (CD*  Combat  CCO)» 
Electronics  Repair  <EL) *  Field  Artillery  (FA) »  General 
Maintenance  (GM> ,  Mechanical  Maintenance  (MM)*  Operators/Food 
(OF),  Survei I lance/Communications  (SC),  and  Skilled  Technician 
(ST)  scores)  does  the  best  job  of  predicting  SQT  scores. 
Multiple  regression  is  the  preferred  procedure  used  in  the 
behavioral  sciences  when  the  object  is  to  determine  which  of 
several  combinations  of  predictors  does  the  best  job  of 
predicting  a  single  criterion;  and  to  determine  how  much  weight 
each  predictor  has  in  the  prediction  of  the  criterion.  Results 
indicated  AFQT  results  significantly  (r=+.27;  F=6.43;  p<.OS) 
predicted  SQT.  A  total  of  7,4  per  cent  of  the  variance  in  SQT 
scores  was  explained  by  AFQT  results.  No  oth»'  variable  or 
combination  ov  variables  made  a  significant,  unique  contribution 
to  the  prediction  of  SQTs  above  and  beyond  what  was  provitfed  by 
AFQTs.  (Technically,  no  other  variable  added  anything  unique  to 
the  prediction  of  SL  3  SQTs  after  AFQT  was  already  in  the 
regression  equation.)  For  this  reason,  the  multiple  regression 
procedure  was  reduced  to  a  sin^sle  Pearson  r  between  AFQTs  and 
SQTs. 

Although  statistically  significant,  the  strength  of  the 
predictive  relationship  between  AFQTs  and  SL*  3  SQT  scores  can 
best  be  described  as  mild:  Although  7.4  per  cent  of  the  variance 
in  SQT  scores  was  explained,  a  total  of  92.6  per  cent  of  SQT 
variance  remains  unexplained  by  ASVAB  results. 


Please  note*  No  other  Pearson  r  correlations  between  ASVAB 
predictors  and  SQTs  were  statistically  significant  at  the  p<.05 


level;  there-forej  no  predictive  relationship?  exists  between  the 
other  ASVA;.  variables  and  SL  3  SQTs. 


(b)  .  A  t  test  was  computed  co  determine  whether  signi-ficant 
di -f -ferences  exist  between  the  SQT  averages  of  soldiers  in  mental 
category  I-IIIA  (upper  50th  percent)  vs.  IIIB-IV  (10  to  49fch 
percent)  on  Armed  Forces  Qualification  Test  results — which  are 
calCwilated  -^rom  ASVAB  subtest  results.  The  difference  between  the 
average  of  82.92  -^or  category  I-IIIA  soldiers  and  (-ne  mean  of 
81.06  for  category  IIIB-IV  personnel  is  not  statistically 
significant  (t-.77;  p;.05).  Therefore?  these  results  do  not 
support  the  contention  that  SQTs  for  75Fs  at  SL  3  increase  with 
mental  category. 

(c) .  A  minimum  passing  SQT  score  of  60  was  determined  by 
subject  matter  experts  at  the  school.  Approximately  7'/.  of  the  75F 
sample  failed  to  meet  this  performance  standard. 

■'‘exti  :■>  frequency  distribution  was  made  of  the  percentages  of 
75Fs  who  nassed  and  failed  (using  the  minimum  passing  SQT  score) 
across  different  .rental  categories,  '^‘esults  were  as  follows! 


PERCENTAGE  OF  PASS. /FAILS  BY  MENTAL  CATEGORY 

MENTAL  CATEGORY 


I-IIIA  illB  IV 

S 

Q  FAIL 

T  <59  and  6.5*/.  2.8%  37.5% 

below)  n=6  n=l  n=3 

S  _ _ 

C  PASS 

0  (60  and  93.5%  97.2%  62.5% 

R  above)  n=86  n=35  n=5 

E _ _ _ _ 


Results  need  to  be  interpr --M-ed  with  caution  due  to  the  small 
number  of  cases  (3)  in  mental  category  IV.  With  this  fact  in 
mind?  results  indicate  that  I-IIIA  and  IIIB  soldiers  fail  less 
and  succeed  more  on  the  SL  3  SQTs  than  their  mental  category  IV 
counterparts.  The  overall  pattern  of  higher  mental  category 
soldiers  doing  better  than  lower  ones  did  not  hold  up  in  the 
comparison  of  I-IIIA  vs,  IIIB  data*  IIIB  had  a  slight  edge  on  I- 
IIIAs  on  both  passes  and  failures. 

(d).  A  simple  frequency  distribution  was  run  to  determine  the 
breakdown  of  soldiers  by  AFQT  mental  categories  in  our  sample. 
Results  indicated  the  followings 


SAMPLE  PERCENTAGES  BY 
AFQT  MENTAL  CATEGORY 

I-IIIA  IIIB  IV 

67.6%  26.5%  5.9% 

n=92  n=36  n=8 


These  percentages  provide  an  approximate  estimate  o-f  the  present 
mental  category  breakdown  -for  75Fs  at  SL  3. 

(e)  .  In  order  to  determine  -future  75F  accession  requirements? 
the  -following  steps  were  taken  CNOTEs  These  steps  are  outlined  in 
Appendix  G  o-f  the  Distribution  of  Quality  Program  HandbookDi 

(1).  A  frequency  distribution  was  made  of  Clerical 
scores.  Clerical  results  were  used  because  a  minimum  Clerical 
score  15  requii'ed  -for  entry  into  the  MOS. 

■;2)  .  The  frequency  distribution  of  Clerical  scores  was 
c-on-verteo  t-o  an  approximate  menpal  category  distribution  using 
tables  and  procedures  outlined  in  the  Distribution  of  Quality 
Program  Handbook.  lNOTEJ  The  frequencies  of  soldiers  which  fell 
within  each  5-point  Clerical  score  category  were  multiplied  by 
separate  *=actors  for  each  mental  category  which  converted 
Clerical  results  into  an  estimated  frequency  distribution  of 
soldiers  by  mental  category.  Please  refer  to  Appendix  G  of  the 
Distribution  of  Quality  Program  Handbook  for  further 
clarification  and  examples  of  this  procedure. 3 

(3) .  Percentages  for  each  mental  category  were 
determined  by  dividing  the  frequencies  of  sums  for  each'  category 
by  the  overall  total  for  all  categories.  (Percentages  were  85.7 
for  category  I-IIIA?  14.3  for  IIIB?  and  0  for  IV.) 

<4) .  Each  mental  category  percentage  was  divided  by  a 
factor  which  controls  for  historical  continuation/survival  rates* 


I-IIIA*  86/. 1058  =  812.85 
IIIB  ;  14/. 1543  =  90.73 
IV  *  0/.1789  =  0 


Total  -  903.58 

<5) .  Final  future  accession  rates  were  determined  by 
dividing  each  of  these  results  by  the  totals 

I-IIIA*  812.85/903.58  =  90.0% 

IIIB*  90.73/903.58  =  10.0% 

IV*  0/903.58  =  0.0% 

e.  Conclusions  and  recommendations 

(1),  In  conclusion?  this  study  found  that* 

(a).  Overall  results  showed  a  mild  positive  predictive 
relationship  between  Armed  Forces  Qualification  Test  results  and 


3L  3  SQTs.  No  other  ASVAB  variable  signi-f icantly  predicted  SQTs. 
Subsequent  analyses  showed  that  73Fs  in  mental  categories  I-IIIA 
and  I I IB  tend  to  do  better  on  SQTs  than  those  in  IV?  however, 
this  pattern  o-f  higher  mental  category  soldiers  doing  better  on 
SQTs  did  not  hold  up  -for  comparisons  o-f  I-IIIAs  vs.  IIIBs?  or  -for 
I-IIIAs  vs  IIIB-IVs. 

(b) .  Approximately  67.6  per  cent  of  75Fs  presently  are  in 
mental  categories  I-lIIA;  26.5  per  cent  are  from  1 1  IB;  and  5.9 
per  cent  are  from  IV. 

(c)  .  According  to  statistical  analysis  results*  90.0  per 
cent  of  future  7SBs  should  come  from  mental  categor-y  I-IIIA?  10.0 
per  cent  should  come  from  1 1  IB?  and  0.0  per  cent  should  co.ne  from 
IV. 


(d).  RECOMMEND  the  use  of  the 
cegression  equation  which  uses  and  Armed 
Test  results  to  predict  success  of  future 
SQTs 


following  multiple 
Forces  Qualification 
75F  recruits  on  the 


(.1735)  ;;  (AFOT)  (73.62)  =  Predicted  3QT  Score 
EXAMPLE: 

(.1735)  ;!  (85)  -t-  (73.62)  =  88.36 

Any  score  which  falls  within  12  points  of  the  SQT  cutoff  (60) 
indicates  a  high-risk  individual.  For  example*  a  recruit  who 
scores  35  on  the  AFQT  obtains  a  predicted  SQT  score  of  88.36— 
which  is  not  within  13  points  ivf  the  cutof-f  (60);  therefore*  this 
soldier  is  not  high  risk  for  failure  on  the  75F  SQT.  Please  note! 
High-risk  individuals  who  are  motivated  and  interested  in  a  75F 
career  might  try  hard  and  be  fully  successful  on  the  SQT? 
nevertheless,  in  the  long  run  more  high-risk  soldiers'will  have 
trouble  with  SQTs  than  nonhigh-risk  individuals. 

(e) .  RECOMMEND  that  further  studies  be  conducted  to 
determine  the  extent  to  which  Clerical  scores  as  presently 
configured  should  continue  to  be  used  as  a  standard  for  accession 
into  the  75F  MOS.  (Perhaps  AFQT  scores*  which  did  significantly 
predict  SQTs*  should  be  used  instead.)  This  recommendation  is 
based  on  the  finding  that  Clerical  scores  did  not  significantly 
predict  SQT  performance. 


(2).  Changes  in  doctrine,  training,  technical  ability*  etc. 
which  are  expected  to  impact  on  the  quality  of  soldiers  needed 
five  years  from  now  include  the  completion  of  fielding  of  TACCS, 
which  will  require  computer  literacy  of  all  7SFs.  Restructuring 
of  personnel  organisations  may  require  an  increise  in  flexibility 
and  per  hap  ts  task  rea)!  ignment.  3  ^ 


(3).  Because  of  the  above  drivers*  the  quality  accession 
7SF  mix  should  be  90,0  per  cent  for  I-IIIA?  10.0  percent  for 
IIIB*  and  0.0  per  cent  for  IV.  Any  reduction  from  this  standard 
will  seriously  degrade  the  7SF*s  ability  to  support  the  soldier 
and  Commander  on  the  battlefield.  r- 


'if.*’*. 
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